1 



(19) 



Europaisches Patentamt 
European Patent Office 
Office europeen des brevets 



111 



(12) 



(H) EP1 158 791 A2 

EUROPEAN PATENT APPLICATION 



(43) Date of publication: 

28.1 1 .2001 Bu lletin 2001/48 



(51) lntCl7: H04N 5/44 



(21) Application number: 01301611.8 

(22) Date of filing: 22.02.2001 



(84) Designated Contracting States: 


(72) 


Inventors: 


AT BE CH CY DE DK ES Fl FR GB GR IE IT LI LU 


• 


Nakamura, Yasufumi, c/o Fujitsu Limited 


MC NL PT SETR 




Kawasaki-shi, Kanagawa 211-8588 (JP) 


Designated Extension States: 


• 


Ito, Tetsunori, c/o Fujitsu Personal 


ALLTLVMKRO SI 




Inagi-shi, Tokyo (JP) 


(30) Priority: 25.05.2000 JP 2000155256 


(74) 


Representative: Mohun, Stephen John 






Haseltine Lake & Co., 


(71) Applicant: FUJITSU LIMITED 




Imperial House, 


Kawasaki-shi, Kanagawa 211-8588 (JP) 




15-19 Kingsway 






London WC2B 6UD (GB) 



(54) Broadcast receiver, broadcast control method, and computer readable recording medium 



(57) A broadcast receiver is provided. This broad- 
cast receiver is capable of avoiding such a problem that 
an audience may lose interest as to a broadcast pro- 
gram even in a CM (commercial message) broadcasting 
time range contained in this broadcast program, while 
the audience need not perform a rapid channel chang- 
ing or "zapping" operation. In the broadcast receiver ac- 



cording to the present invention, a single set of highlight 
scene, or plural sets of highlight scenes are detected 
from a broadcast program provided to the audience, and 
then, are stored in a storage device. Thereafter, when 
a CM broadcast program is commenced, the highlight 
scene is read out from the storage device so as to be 
reproduced. 
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Description 

[0001] The present invention generally relates to a 
broadcast receiver, a broadcast control method, and a 
computer readable recording medium. More specifical- 
ly, the present invention is directed to a broadcast re- 
ceiver and a broadcast control method, which are capa- 
ble of effectively utilizing CM broadcasting time (com- 
mercial broadcasting time) within a broadcasting pro- 
gram, and also directed to a recording medium for re- 
cording thereon a computer readable program used to 
execute the broadcast control method. 
[0002] Very recently, various sorts of broadcasting 
networks appear in addition to the normally available tel- 
evision broadcasting system using the ground waves, 
known as cable television broadcasting systems and 
BS/CS satellite broadcasting systems using satellites. 
As a result, possibilities capable of selecting desirable 
programs are increased with respect to audiences. Also, 
the analog TV broadcasting systems such as the pres- 
ently available ground wave TV broadcasting system 
will be replaced by the digital TV broadcasting systems 
such as the CS broadcasting system. Both the BS 
broadcasting systems and the ground wave broadcast- 
ing systems are decided to be replaced by the digital TV 
broadcasting systems in near future. 
[0003] In near future, a watching style called as a 
"time shift watching (listening/viewing) style" may be ex- 
ecuted to constitute a general-purpose watching style, 
since low cost and large capacities of random -accessi- 
ble storage media (e.g., hard disks) may be greatly re- 
alized, and further, the analog broadcasting systems are 
substituted by digital broadcasting systems. 
[0004] The time shift watching style implies such a 
style that random access media constituted in a logical- 
ly-ring-shaped form is prepared as a buffer for tempo- 
rarily storing thereinto reception data, and an audience 
watches a broadcast program while broadcast data re- 
ceived when the broadcast program is received is tem- 
porarily stored into the random access media. Since 
broadcast program data corresponding to the storage 
capacities of the random access media are saved there- 
in, trick plays such as seek, pause, and replay opera- 
tions may be realized at arbitrary timing within a watch- 
ing broadcasting program by accessing this program 
data at random. 

[0005] In receivers capable of realizing the time shift 
watching style, audiences may repeatedly view so-far- 
missed scenes. Also, even in such a case that a tele- 
phone call is made while an audience watches a broad- 
cast program and/or a visitor suddenly comes so that 
the audience leaves from the present location to another 
location, if the present time is defined within a remaining 
storage capacity of random access media, then the au- 
dience may temporarily stop watching of the program, 
and after the audience finishes the subject matter, the 
audience again may restart watching the interrupted 
program content. 
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' [0006] Japanese Patent Application Laid-open No. 
Hei 6-1 4274 discloses the technique of the television re- 
ceiver capable of realizing the time shift watching style, 
and also Japanese Patent Application Laid-open Hei 

5 7-264529 describes the technique of such an apparatus 
capable of realizing the time shift watching style. 
[0007] Fig. 38 is a diagram for representing a relation- 
ship between address positions and reproducing time 
of writing operation and reading operation with respect 

10 to a disk which is used as a buffer (will be referred to as 
a "buffer disk") when the time shift watching style is per- 
formed. 

[0008] Since a broadcast receiver receives broadcast 
data in a constant bit rate, a data writing rate with respect 
15 to a buffer disk is constant. As a result, as indicated by 
a dotted line in Fig. 38, a relationship between time and 
an address during writing operation becomes a straight 
line. Accordingly, since broadcast data is read out from 
the buffer disk at the same rate as the write rate, b road- 
ie cast data can be reproduced in the normal speed. Sym- 
bols "tO" to "t2" show,n in Fig. 38 correspond to broadcast 
data reproduction in the normal speed. 
[0009] In such a case that an audience again wishes 
to watch a broadcast program from the beginning por- 
25 tion thereof at the time instant '12" shown in Fig. 38, a 
position of an address "a0" is sought to set a read ad- 
dress. Thereafter, if the broadcast data is read at the 
normal speed rate, then the audience can again watch 
this broadcast program from the beginning portion 
30 thereof. 

[0010] In such a case that the audience wants to re- 
produce the broadcast data in the fast forward mode in 
the time shift watching style, the read rate is set to be- 
come higher than the normal rate. This corresponds to 
35 the time instants "t2" to "t3" shown in Fig. 38. During the 
time period, the inclination of the straight line becomes 
larger than that when the reproduction is performed in 
the normal speed. 

[001 1 ] Symbols ,l t3" to "t6" shown in Fig. 38 represent 
40 that the broadcast data is reproduced under time shift 
condition and also in the normal speed. This is called as 
an offset watching style. In this offset watching style, a 
straight line of a writing rate and also a straight line of a 
reading rate in Fig. 38 become in parallel to each other. 
45 in this case, a delay from the actual broadcasting time 
instant is equal to (t3 - 11 ), since a scene which has been 
broadcasted at the time instant "t1 " is watched at a time 
instant "t3". 

[0012] In the case of such a receiver which supports 
50 a reverse reproducing operation, when the broadcast 
data is reverse- reproduced, it becomes time instants 
•16" to "17" shown in Fig. 38. Since the broadcast data 
is read from the read address in the reverse direction, 
the read address is decreased while time has passed. 
55 The inclination of the straight line becomes a negative 
value. 

[0013] When the audience pauses at a certain posi- 
tion while the broadcast data is reproduced, as shown 
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in symbols B t7 a to 18" of Fig. 38. there is no change in 
the position of the read address a3, but only time is 
changed from the time instant M t7 H to the time instant 
"t8. u Thereafter, in order to catch up the real-time broad- 
cast program, the write address is made equal to the 
read address. In Fig. 38, at the time instant '18", the real- 
time broadcast program can be caught up. Subsequent- 
ly, the audience can watch the program identical to the 
real-time broadcast. 

[0014] Since future reception data which has not yet 
been stored cannot be read out from the buffer disk, a 
solid line which indicates a change in reading time can- 
not be located above a dotted line which represents a 
change in writing time. 

[0015] As actions of audiences, a successive channel 
changing or so-called "zapping action (zapping opera- 
tion)" is usually carried out by these audiences. In this 
zapping action, when a commercial message (CM) pro- 
gram is commenced and this CM program has no direct 
relationship with a broadcast program which is being 
watched by an audience, this audience successively 
changes broadcast channels in order to seek other fa- 
vorable programs. Various technical ideas capable of 
supporting this zapping action have been proposed. 
[0016] Japanese Patent Application Laid-open No. 
Hei 5-316440 discloses the following technique of the 
TV receiver. That is, while the CM program contained in 
the broadcast program is detected from the speech con- 
trol signal of the receiving broadcasting system, this TV 
receiver automatically switches this receiving broad- 
casting channel to other broadcasting channel, or a pre- 
viously-registered specific channel. Furthermore, this 
patent application discloses such a technical idea that 
even after the present broadcasting channel has been 
changed into another broadcasting channel, the original 
broadcasting channel is kept under reception condition. 
At the time instant when the CM program of the original 
broadcasting program is ended, the television receiver 
is automatically returned to the original broadcasting 
channel. 

[001 7] As to such a technical point that another infor- 
mation is viewed during CM broadcasting, Japanese 
Patent Application Laid-open No. Hei 11-146296 dis- 
closes the technical idea capable of automatically dis- 
playingthe Image information such as the Internet home 
page whllethe CM program is detected. Also, this patent 
application describes that an the information provided 
instead of the CM program, the retrieved results ob- 
tained from the various sorts of information database 
which are stored in the CD-ROM and the like are exem- 
plified in addition to the Internet home page. 
[0018] In order to recognize a certain scene contained 
in a picture (video image) as a highlight scene, such a 
tag which may indicate "highlight scene - must be added. 
A tag may be realized by previously adding tag data 
when broadcast data is transmitted on the side of a 
transmission station. Alternatively, a tag may be added 
on the side of a receiver. There are two tag adding meth- 
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ods executed on the side of the receiver, namely a man- 
ual tag adding method and an automatic tag adding 
method. Since such a tag indicative of "highlight scene" 
is added to broadcast data, there are such merits that 

5 saved pictures may be simply retrieved, and contents of 
saved pictures may be grasped in short time. 
[0019] Various retrieving methods have been pro- 
posed as to an automatic highlight scene retrieving 
method. For example, Japanese Patent Application 

10 Laid-open No. Hei 9-65287 discloses the technique of 
the featured scene listing method. That is, while the spe- 
cific picture effect called "desolve" contained in the 
broadcast program is sensed, the scene representative 
of the moving picture is specified. 

15 [0020] However, the above-explained known tech- 
niques have the below-mentioned problems. That is, the 
audience is normally relaxed while watching the broad- 
cast program at home. Under such a circumstance, the 
audience never performs the time shift watching style 

20 unless there is such a specific reason that the program 
watching action byjhe audience is disturbed by the tel- 
ephone call and/or the visitor. Also, in the prior tech- 
nique, the audience must issue such an instruction by 
himself, namely, a chance to replay a program watched 

25 in a real time mode in a half way. 

[0021 ] The reasons why the zapping operation is car- 
ried out by audiences are mainly given as follows: 

(1) . In such a case that an audience does not have 
30 a clear decision on the next program after a pres- 
ently watched broadcast program is ended, this au- 
dience has a necessary and positive reason direct- 
ed to a program search, namely the audience 
roughly checks all of presently watchable programs 

35 and then searches a favorable program. 

(2) . An audience has such a passive reason: When 
the audience thinks it a waste of time merely to 
watch a CM program this audience tries to search 
another channel program. Namely -the presently 

40 watched CM program is replaced by the favorable 
broadcast program. 

(3) . An audience has a positive reason without any 
necessity: Since this audience cannot be satisfied 
with the presently watched program, the audience 

45 tries to search the more enjoyable program. 

(4) . A reason is established by combining the 
above-explained reasons (1) to (3). 

[0022] Generally speaking, such a zapping operation 
50 becomes effective in such a case that an audience can 
find out more favorable program in another channel, as 
compared with the presently watched program. Howev- 
er, there are many possibilities that while a CM program 
is broadcast in a certain channel, CM programs are sim- 
55 iiarly broadcast in other channels. Finally since the au- 
dience could not find out his favorable program in an- 
other channel, this audience is returned to the originally 
watched program. Moreover, when the audience is re- 
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turned to the original channel, there are many chances 
that the CM broadcast has already been accomplished, 
and therefore, this audience loses a head portion of a 
broadcast program after this CM broadcast is accom- 
plished. 5 
[0023] Also, since the zapping operation is required 
to perform the remote control many times, this remote 
control operation may cause very cumbersome opera- 
tions for the audience, tn the case that all of channels 
are not always free channels, but some channels are 
paid-channels, if an audience performs the zapping op- 
eration under careless condition, then the audience mis- 
takenly watches such a paid-channel program, which 
may cause unnecessary expense. 
[0024] When the known technique disclosed in Japa- 
nese Patent Application Laid-open No. Hei 5-316440 is 
used (namely, CM program is automatically detected to 
change present channel into another channel), the man- 
ual cumbersome operation required in the zapping op- 
eration can be eliminated. However, this known tech- 
nique could not solve other difficulties. That is, the CM 
programs are similarly broadcast in other channels, and/ 
or no other favorable programs are broadcast in other 
channels. 

[0025] On the other hand, when the known technique 
disclosed in Japanese Patent Application Laid-open No. 
Hei 1 1 -146296 is used (namely, other image information 
is displayed while CM program is broadcasted) , the pur- 
pose forthe CM program substitution (namely, audience 
watches information other than CM program) can be 
achieved. However, this technique cannot meet such a 
requirement that the audience wishes to watch once 
again the highlight scene of the originally watched pro- 
gram by utilizing watching time for the CM program. 
[0026] In general, a large number of CM programs are 
inserted into a time duration defined after a broadcast 
program is ended and before the next broadcast pro- 
gram is commenced. Also, spot news programs and 
weather forecast programs are inserted into this time 
duration. However, it is a waste of time when an audi- 
ence again watches news programs and weather fore- 
cast programs, which have been already watched/ 
known by this audience. As a consequence, the audi- 
ence tries to change the presently watched channel into 
another channel. However, there are many opportuni- 
ties that news programs and/or weather forecast pro- 
grams are similarly broadcast in other channels at this 
channel change time. Therefore, the audience could not 
effectively utilize the time duration defined after one pro- 
gram is ended and until the next program is started, so 
that this audience may feel stress. 
[0027] Embodiments of the present invention may 
provide a broadcast receiver, a broadcast control meth- 
od, and also a recording medium for recording thereon 
a computer program, by which an audience can avoid 
losing interest as to a content of a broadcast program 
even in a CM broadcasting time range contained in this 
broadcast program, while this audience no longer per- 
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forms the zapping operation. 

[0028] The present invention aims to solve the above- 
described problems by employing the below-mentioned 
arrangements: 

[0029] That is, a broadcast receiver, according to the 
present invention, is featured by comprising: a highlight 
scene detecting unit for detecting a highlight scene of a 
broadcast program; means for storing at least the de- 
tected highlight scene of the program into a storage de- 
vice; a CM detecting unit for detecting a CM (commercial 
message) broadcast program; and a reproducing con- 
trol unit for reproducing the highlight scene stored in the 
storage device while the CM program is broadcast. 
[0030] In the broadcast receiver of the present inven- 
tion, the CM detecting unit includes a CM start detecting 
unit for detecting a commencement of the CM broad- 
cast; and when the CM broadcast is commenced, the 
reproduction of the highlight scene may be commenced. 
[0031 ] In the present invention, a broadcast contains, 
for instance, a television broadcast or a radio broadcast. 
A broadcast receive r, according to the present inven- 
tion, may be applied to a television broadcast receiver, 
a radio broadcast receiver (e.g., radio broadcasting sys- 
tem and/or radio-character broadcasting system), and 
the like. 

[0032] Also, in the present invention, an "audience" 
may include a person who watches a television broad- 
cast program or a person (listener, or receiver) who lis- 
tens to a radio broadcast program. A detection of a high- 
light scene may be realized as follows: A portion capable 
of satisfying a predetermined detection condition may 
be detected as a highlight scene by executing an image 
recognition process operation and/or a speech recogni- 
tion process operation. Also, such a portion may be de- 
tected based upon an index contained in broadcast da- 
ta, or in response to an instruction of an audience. 
[0033] In accordance with the present invention, while 
an audience watches a broadcast program, when a CM 
program is commenced, the audience can watch a high- 
light scene of this broadcast program. In this way, the 
highlight scene of the broadcast program can be provid- 
ed while the CM program is broadcast. Thus, the audi- 
ence need not perform the zapping operation which is 
carried out in the known broadcast receiver. Also, the 
present Invention can avoid such a problem that the au- 
dience loses interest and also concentration with re- 
spect to the broadcast program which is being watched, 
which is derived from the fact that the audience mistak- 
enly receives other information by watching the CM pro- 
gram and also by performing the zapping operation. 
[0034] Also, the broadcast receiver, according to the 
present invention, may be arranged by such that the 
storage device stores thereinto a data portion of the 
broadcast data corresponding to a predetermined time 
duration at any time; and in such a case that when the 
CM broadcast is ended, the reproduction of the highlight 
scene has not yet accomplished, the reproducing con- 
trol unit reproduces such broadcast data as appeared 
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just after the CM broadcast is ended after the reproduc- 
tion of the highlight scene is reproduced. A term "broad- 
cast data" involves picture (image) data and/or speech 
(voice) data related to a broadcast program, and further- 
more, picture (image) data and/or speech (voice) data s 
related to a CM program. 

[0035] Also, the broadcast receiver, according to the 
present invention, may be arranged by that in such a 
case that when the broadcast data is reproduced, a next 
CM broadcast is commenced, if a time difference be- 
tween a broadcast time instant and a reproduction time 
instant exceeds broadcast time of the next CM broad- 
cast program, the reproducing control unit continues to 
reproduce the broadcast data without executing the re- 
production of the highlight scene. A term "broadcast 
time instant" indicates a time instant elapsed in accord- 
ance with a broadcast program such as a television and 
a radio, whereas a term "reproducing time instant" indi- 
cates a time instant (actual time instant) when broadcast 
data stored in a storage device is reproduced. 
[0036] Also, the broadcast receiver, according to the 
present invention, may have a structure such that the 
storage device stores thereinto a data portion of the 
broadcast data corresponding to a predetermined time 
duration at any time; and when the CM broadcast is 
commenced, the reproducing control unit reproduces as 
the highlight scene, a broadcast data portion which is 
stored in the storage device, and is defined from a time 
instant when the CM broadcast is started and until a 
preselected time duration is retraced. 
[0037] Also, the broadcast receiver, according to the 
present invention, may have a structure such that the 
broadcast program contains first speech (voice) and 
second speech (voice); and the broadcast receiver may 
further comprise: speech control means for providing 
any one of the first speech and the second speech when 
the broadcast program is provided in connection with a 
broadcast time instant; and also for providing the other 
speech between the first speech and the second speech 
when the highlight scene is reproduced. 
[0038] Also, the broadcast receiver, according to the 
present invention, may be configured such that the 
broadcast receiver is further comprised of: a highlight 
scene classifying unit for classifying the highlight scenes 
stored in the storage device into plural sorts of classifi- 
cations; and the reproducing control unit reads out such 
a highlight scene having a scrt corresponding to a taste 
of an audience with having a top priority from the storage 
device to reproduce the read highlight in such a case 
that the CM broadcast is commenced. 
[0039] Also, the broadcast receiver, according to the 
present invention, may have a structure such that the 
reproducing control unit reproduces any one of the high- 
light scene and a digest constituted of plural highlight 
scenes of a certain broadcast program during a time pe- 
riod defined after the certain broadcast program is end- 
ed and until a next broadcast program is commenced. 
[0040] Further, a broadcast control method, accord- 



ing to the present invention, is featured by that a high- 
light scene of a broadcast program is detected; at least 
the detected highlight scene of the program is stored 
into a storage device; a CM (commercial message) 
broadcast program is detected; and the highlight scene 
stored in the storage device while the CM program is 
broadcast is reproduced. 

[0041 ] Moreover, a computer readable recording me- 
dium for recording thereon a computer program, accord- 
ing to the present invention, is featured by such a re- 
cording medium for recording thereon a program used 
to cause a computer to execute: a step for detecting a 
highlight scene of a broadcast program; a step for stor- 
ing at least the detected highlight scene of the program 
into a storage device; a step for detecting a CM (com- 
mercial message) broadcast program; and a step for re- 
producing the highlight scene stored in the storage de- 
vice while the CM program is broadcast. 
[0042] Embodiments of the present invention will now 
be described, byway of example only, with reference to 
the accompanyingjirawings, in which: 

Fig. 1 schematically shows a hardware structure of 
a computer which may function as a broadcast re- 
ceiver according to the present invention; 
Fig. 2 is a functional block diagram of a broadcast 
receiver according to a first embodiment of the 
present invention; 

Fig. 3 is a diagram for explaining a highlight index 
storage unit of the broadcast receiver according to 
the first embodiment; 

Fig. 4 is a diagram for explaining a CM index stor- 
age unit of the broadcast receiver according to the 
first embodiment; 

Fig. 5 is a flow chart for describing operations of the 
broadcast receiver according to the first embodi- 
ment; 

Fig. 6 is a flow chart for describing a highlight ana- 
lyzing process operation of the broadcast receiver 
according to the first embodiment; 
Figs. 7A and 7B are flow charts for describing both 
a CM starting index storage process operation and 
a CM end index storage process operation, which 
are executed in the broadcast receiver according to 
the first embodiment; 

Fig. 8 is a flow chart for describing a highlight se- 
lecting process operation of the broadcast receiver 
according to the first embodiment; 
Fig. 9 is a diagram for representing a relationship 
between a write address and a read address with 
respect to a buffer disk of the broadcast receiver 
according to the first embodiment; 
Fig. 1 0 is a functional block diagram of a broadcast 
receiver according to a second embodiment of the 
present invention; 

Fig. 11 is a flow chart for describing a highlight an- 
alyzing process operation executed in the broad- 
cast receiver according to the second embodiment; 
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Fig. 1 2 is a functional block diagram of a broadcast 
receiver according to a third embodiment of the 
present invention; 

Fig. 13 is a diagram for explaining an input device 
(remote controller) of the broadcast receiver ac- 5 
cording to the third embodiment; 
Fig. 14 is a flow chart for describing a highlight an- 
alyzing process operation executed in the broad- 
cast receiver according to the third embodiment; 
Fig. 1 5 is a flow chart for describing operations of a 10 
broadcast receiver according to a fourth embodi- 
ment of the present invention; 
Fig. 16 is a diagram for representing a relationship 
between a write address and a read address with 
respect to a buffer disk employed in the broadcast 15 
receiver according to the fourth embodiment of the 
present invention; 

Fig. 1 7 is a diagram for indicating a relationship be- 
tween a write address and a read address with re- 
spect to a buffer disk employed in a broadcast re- 20 
ceiver according to a fifth embodiment of the 
present invention; 

Fig. 18 is a diagram for representing a relationship 
between a write address and a read address with 
respect to a buffer disk employed in a broadcast re- 25 
ceiver according to a sixth embodiment of the 
present invention; 

Fig. 1 9 is a diagram for indicating a relationship be- 
tween a write address and a read address with re- 
spect to a buffer disk employed in a broadcast re- 30 
ceiver according to a seventh embodiment of the 
present invention; 

Fig. 20 is a diagram for explaining a highlight index 
storage unit employed in a broadcast receiver ac- 
cording to an eighth embodiment of the present in- 35 
vention; 

Fig. 21 is a diagram for representing a relationship 
between a write address and a read address with 
respect to a buffer disk employed in the broadcast 
receiver according to the eighth embodiment of the 40 
present invention; 

Fig. 22 is a diagram for indicating a relationship be- 
tween a write address and a read address with re- 
spect to a buffer disk employed in a broadcast re- 
ceiver according to a ninth embodiment of the 45 
present invention; 

Fig. 23 is a functional block diagram of a broadcast 
receiver according to a tenth embodiment of the 
present invention; 

Fig. 24 is a flow chart for describing operations of so 
the broadcast receiver according to the tenth em- 
bodiment; 

Fig. 25 is a functional block diagram of a broadcast 
receiver according to an 11th embodiment of the 
present invention; 55 
Fig. 26 is a functional block diagram of a broadcast 
receiver according to a 12th embodiment of the 
present invention; 
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Fig. 27 is a diagram for explaining a highlight index 
storage unit employed in the broadcast receiver ac- 
cording to the 12th embodiment; 
Fig. 28 is a diagram for explaining a user taste da- 
tabase employed in the broadcast receiver accord- 
ing to the 12th embodiment; 
Fig. 29 is a functional block diagram of a broadcast 
receiver according to a 13th embodiment of the 
present invention; 

Fig. 30 is a flow chart for describing operations of 
the broadcast receiver according to the 1 3th em- 
bodiment; 

Fig. 31 is a diagram for indicating an example of a 
screen display image of the broadcast receiver ac- 
cording to the 13th embodiment; 
Fig. 32 is a flow chart for describing operations of a 
broadcast receiver according to a 14th embodiment 
of the present invention; 

Fig. 33 is a diagram for indicating an example of a 
screen display image of the broadcast receiver ac- 
cording to theJ4th embodiment; 
Fig. 34 is a functional block diagram of a broadcast 
receiver according to a 15th embodiment of the 
present invention; 

Fig. 35 is a flow chart for describing operations of 
the broadcast receiver according to the 1 5th em- 
bodiment; 

Fig. 36 is a diagram for indicating an example of a 
screen display image of the broadcast receiver ac- 
cording to the 15th embodiment; 
Fig. 37 is a diagram for showing a relationship be- 
tween a write address and a read address with re- 
spect to a buffer disk employed in a broadcast re- 
ceiver according to a 16th embodiment of the 
present invention; and 

Fig. 38 is a diagram for representing the relationship 
among the write address, the read address, and the 
reproduction time with respect to the buffer disk dur- 
ing time shift watching operation, 

[FIRST EMBODIMENT] 

HARDWARE CONSTRUCTION OF BROADCAST 
RECEIVER 

[0043] Fig. 1 is a hardware structural diagram of a 
computer 1 which may function as a broadcast receiver 
(will be simply referred to as a "receiver" hereinafter) ac- 
cording to the present invention, and may realize a 
broadcast control method according to the present in- 
vention. The computer 1 corresponds to, for instance, a 
personal computer, a workstation, and the like (so- 
called TV-personal computer"), which is equipped with 
a digital television broadcasting reception function , and 
may function as a television broadcast receiver. 
[0044] In Fig. 1 , the computer 1 is provided with a CPU 
(Central Processing Unit) 2, a ROM (Read-Only Mem- 
ory) 3, a RAM (Random Access Memory) 4, a hard disk 
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(HD) 5, floppy disk drive (FDD) 6, a CD-ROM drive 7, a 
display control apparatus 8, a communication control 
apparatus 9, and a plurality of interface circuits (l/F) 1 0 
to 12. 

[0045] The ROM 3 previously stores thereinto an ini- 5 
tiation program. The initiation program is executed by 
the CPU 2 when the power supply of the computer 1 is 
turned ON. As a result, both an operating system (OS) 
and either a single sort, or plural sorts of drive software 
(drivers) are loaded on the RAM 4, so that various sorts 
of process operations and control operations are 
brought into executable conditions. The single sort, or 
plural sorts of drivers and also the operating system, 
which have been previously stored in the hard disk HD 
5, are used to execute a display process operation and 
a communication process operation. 
[0046] Various sorts of computer programs for con- 
trolling the computer 1 are expanded to the RAM 4, and 
this RAM 4 is used as a work area of the CPU 2. As a 
result, the RAM 4 may save a process result by a com- 
puter program, such temporarily-processed data used 
to execute a process operation, and such display data 
used to display the process result and the like on the 
display screen on the display apparatus 15. 
[0047] The display data expanded on the RAM 4 is 
transferred via the display control apparatus 8 to the dis- 
play apparatus 1 5. Upon receipt of the display data, the 
display apparatus 15 displays a display content corre- 
sponding to the display data on the display screen there- 
of. 

[0048] The HD 5 is a recording medium operable in 
such a manner that in response to an instruction issued 
from the CPU 2, this recording medium records thereon 
a program, control data, text data, image data, and the 
like. It should be noted that data/program read/write-op- 
erations with respectto this hard disk HD 5 are executed 
by a hard disk drive (not shown in detail). 
[0049] The floppy disk drive FDD 20 corresponds to 
such a device used to execute either a read operation 
or a write operation with respect to a floppy disk (FD) 
13. In response to an instruction issued from the CPU 
2, this FDD 20 may read/write a program, control data, 
text data, image data, and the like with respect to the 
FD 13. 

[0050] The CD-ROM drive 7 corresponds to such a 
device capable of reading a program and/or data previ- 
ously recorded on a CD-ROM 14 in response to an in- 
struction issued from the CPU 2. The CD-ROM 14 is 
such a read-only memory using a compact disk (CD). 
[0051] The display apparatus 1 5 is connected to the 
display control apparatus 8. The display apparatus 15 
is equipped with a monitor and a speaker used to output 
speech. The monitor is constructed of a cathode-ray 
tube (CRT), a liquid crystal display (LCD), and the like. 
[0052] The display control apparatus 8 contains a de- 
coder 8a (see Fig. 2). The decoder 8a decodes, or de- 
modulates both image data and speech (voice, sound) 
data contained in broadcast data inputted into the com- 



puter 1 so as to obtain such data having a format proc- 
essable by the display apparatus 1 5. Both the image da- 
ta and the speech data contained in the broadcast data 
entered into the computer 1 are demodulated by the dis- 
play control apparatus 8. and then, the demodulated im- 
age/speech data are processed by way of either the im- 
age display control process or the speech output control 
process, if required. Thereafter, the processed image/ 
speech data are supplied to the display apparatus 15. 
[0053] To the communication control apparatus 9, a 
communication line connected to a network (not shown) 
is connected. In response to an instruction issued from 
the CPU 2, the communication control apparatus 9 
transmits/receives (involving uploads/downloads) a 
program and/or data with respect to another computer. 
[0054] A keyboard (KBD) 1 6 is connected to the inter- 
face l/F 1 0. This keyboard (KBD) 16 is provided with a 
plurality of keys (character input keys and cursor key 
etc.), and is used by an operator in order to input an 
instruction and data to the computer 1 . 
[0055] Either a rrjpuse 1 7 or a pointing device such as 
a track ball, a flat space, and a joystick is connected to 
another interface l/F 11 . The mouse 17 is used to input 
a selection instruction by employing a cursor displayed 
on the monitor of the display apparatus 15. 
[0056] A tuner 18 used to receive a digital television 
broadcasting program is connected to another interface 
l/F 12. This tuner 1 8 is connected to an antenna 19 for 
receiving digital television broadcasting electromagnet- 
ic waves such as CS broadcasting programs. The tuner 
18 converts a digital TV broadcasting electromagnetic 
wave into a digital signal containing image data and 
speech data, and then, this converted digital signal is 
entered into the l/F 12. The l/F 12 converts a digital TV 
signal entered from the tuner 12 into such data having 
a format processable by the computer 1 , and then, out- 
puts this converted data to the bus BUS. 
[0057] The CPU 2 executes various sorts of programs 
stored in the ROM 3, the HD 5, the FO 13, and the CD- 
ROM 14 (namely, these devices correspond to 'record- 
ing medium" of the present invention) . As a result, the 
computer 1 may function as a broadcast receiver ac- 
cording to the present invention. It should be understood 
that the above-described programs and also data to be 
saved in the recording medium such as the HD 5 may 
be recorded on this recording medium by an operator in 
a manual manner. Alternatively, the computer 1 may 
download these programs/data from another computer 
to be recorded on the recording medium. 
[0058] Furthermore, the arrangement of the computer 
1 shown in Fig. 1 may be replaced by that in which the 
tuner 18 is built in the computer 1. Also, the decoder 
may be provided outside this computer 1 . 
[0059] It should also be noted that the CPU 2 may re- 
alize a highlight scene detecting unit, a means for stor- 
ing a highlight scene into a storage device, a CM detect- 
ing unit, a CM start detecting unit, and a reproduction 
control unit. The hard disk HD 5 (buffer disk 21) corre- 
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sponds to the storage device according to the present 
invention. 

FUNCTIONAL BLOCK OF BROADCAST RECEIVER 

[0060] Fig. 2 is a functional block diagram for showing 
an arrangement of a broadcast receiver according to a 
first embodiment of the present invention. The computer 
1 indicated in Fig. 1 may function as a receiver 20 which 
is connected to the tuner 18 and the decoder 8a con- 
tained in the display control apparatus 8, as shown in 
Fig. 2, since the CPU 2 executes a computer program. 
[0061] The tuner 18 receives a broadcasting electro- 
magnetic wave received by the antenna 19, and then 
enters both image (video) data and speech (audio) data 
contained in the broadcasting electromagnetic wave in- 
to this receiver 20. The decoder 8a decodes (demodu- 
lates) both the image data and the speech data con- 
tained in the broadcasting electromagnetic wave, and 
then, supplies the decoded image/speech data to the 
display apparatus 15. 

[0062] As a result, an image data (picture) produced 
from the image data is displayed on the monitor of the 
display apparatus 1 5, and also speech (voice) produced 
from the speech data is outputted from the speaker. 
Therefore, the television broadcast programs may be 
provided with audiences. 

[0063] The receiver 20 is equipped with a buffer disk 
21 , a highlight scene analyzing unit 22, a CM start sens- 
ing unit 23, a CM end sensing unit 24, a highlight index 
storage unit 25, a CM index storage unit 26, a reproduc- 
ing management unit 27, and a switch 28. The highlight 
scene analyzing unit 22 (will be referred to as an "ana- 
lyzing unit 22" hereinafter) corresponds to a highlight 
scene detecting unit. The CM start sensing unit 23 cor- 
responds to a CM detecting unit, and a CM start detect- 
ing unit. The CM end sensing unit 24 corresponds to a 
CM detecting unit. The highlight index storage unit 25 
corresponds to a means for storing a highlight scene into 
the storage device. The reproducing management unit 
27 corresponds to a reproduction control unit. The ana- 
lyzing unit 22, the CM start sensing unit 23, the CM end 
sensing unit 24, and also the reproducing management 
unit 27 are such functions which can be realized by that 
the CPU 2 executes a computer program. 
[0064] The buffer disk 21 corresponds to such a ring 
buffer for temporarily storing thereinto broadcast data 
portions outputted from the tuner 1 8 only for a predeter- 
mined time duration. When the buffer disk 21 stores the 
broadcast data up to a final address, the next address 
is returned to a head address. While the tuner 18 and 
the receiver20 are initiated, this buffer disk21 arbitrarily, 
or temporarily stores thereinto the broadcast data of the 
selected channel. 

[0065] In this example, the buffer disk 21 is constitut- 
ed by employing a hard disk. Alternatively, if random ac- 
cessible media are available, then any type of random 
accessible media, for example, a RAM disk may be used 
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as this buffer disk 21 . 

[0066] The analyzing unit 22 acquires the broadcast 
data which is stored from the tuner 1 8 to the buffer disk 
21 , and then, analyzes the acquired broadcast data so 
5 as to detect a highlight scene of a broadcasting pro- 
gram. This analyzing unit 22 stores index information 
corresponding to the detected highlight scene into the 
highlight index storage unit 25. 

[0067] The analyzing unit 22 detects the highlight 

10 scene in accordance with both a detection starting con- 
dition and a detection end condition of the highlight 
scene, which are previously set, while using both the 
image data and the speech data contained in the broad- 
cast data. In other words, the analyzing unit 22 detects 

*5 as the highlight scene such broadcast data defined from 
a data portion coincident with the detection starting con- 
dition up to a data portion coincident with the detection 
end condition, as a result of an image recognition proc- 
ess, and a speech recognition process, and also a com- 

20 bination of these process operations. 

[0068] The analyzing unit 22 sets as a detection start- 
ing condition, for instance, such a condition that a dif- 
ference between a preceding frame and a succeeding 
frame within an image is calculated, and an absolute val- 

25 ue of this difference is larger than a predetermined 
threshold value, and further, a level of speech corre- 
sponding to the image is higher than a preselected 
threshold value. Then, the analyzing unit 22 detects im- 
age data defined from the image portion capable of sat- 

30 isfying this detection starting condition up to the image 
portion capable of satisfying a detection end condition 
as the above-described highlight scene. 
[0069] Also, the analyzing unit 22 detects the highlight 
scene, while a change in major colors of a screen is 

35 sensed so as to sense a change in displayed images, 
or a change in luminance brightness is utilized. Alterna- 
tively, the analyzing unit 22 detects as the highlight 
scene such an image where a specific key word (for ex- 
ample, name of hero) is recognized, while the image 

40 recognition process is combined with the speech recog- 
nition process. 

[0070] Then, the analyzing unit 22 detects both the 
starting time instant and the end time instant of the high- 
light scene, the addresses (namely, both starting ad- 
45 dress and end address) of the highlight scene on the 
buffer disk 21 ; and also the length of the high light scene. 
The analyzing unit 22 stores all of the above-described 
data into the highlight index storage unit 25 as the index 
information. 

so [0071 ] Fig. 3 is an explanatory diagram for explaining 
the content of the highlight index storage unit 25 shown 
in Fig. 2. As indicated in Fig. 3, the highlight index stor- 
age unit 25 corresponds to such a table which records 
thereon index information of highlight scenes every 

55 highlight scene. This index information implies a starting 
time instant, a starting address, an end time instant, an 
end address, and a length. This table is formed on the 
RAM 4. 
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[0072] Returning back to Fig. 2, the CM start sensing 
unit 23 senses a start of a CM (commercial) program 
contained in a broadcasting program in such a manner 
that the CM start sensing unit 23 judges as a CM starting 
time instant, such a time instant at which a sound mode 5 
contained in broadcasting data stored in the buffer disk 
21 is changed from a monoral sound mode to a stereo- 
phonic sound mode. When the CM start sensing unit 23 
senses starting of the CM program, this CM start sens- 
ing unit 23 acquires this starting time instant, and the 
address (starting address) of the broadcasting data cor- 
responding to this starting time instant in the buffer disk 
21 . Then, the CM start sensing unit 23 stores the ac- 
quired CM starting time instant and the starting address 
into the CM index storage unit 26. 
[0073] The CM end sensing unit 24 senses an end of 
a . CM (commercial) program contained in a broadcast- 
ing program in such a manner that the CM end sensing 
unit 24 judges as a CM end time instant, such a time 
instant at which a sound mode contained in broadcast- 
ing data stored in the buffer disk 21 is changed from a 
stereophonic sound mode to a monoral sound mode. 
When the CM end sensing unit 24 senses the end of the 
CM program, this CM end sensing unit 24 acquires this 
end time instant, and the address (end address) of the 
broadcasting data corresponding to this end time instant 
in the buffer disk 21 . Then, the CM end sensing unit 24 
stores the acquired CM end time instant and the end 
address into the CM index storage unit 26. 
[0074] As the CM start sensing method by the CM 
start sensing unit 23, or the CM end sensing method by 
the CM end sensing unit 24, either the CM starting point 
or the CM end point may be sensed from a blank image 
portion between two continuous senses by way of a 
method similar to the analyzing unit 22, or may be 
sensed by utilizing such a fact that a sound volume level 
of a CM program is higher than that of a broadcasting 
program. 

[0075] Fig. 4 is an explanatory diagram for explaining 
the content of the CM index storage unit 26 shown in 
Fig. 2. As indicated in Fig. 4, the CM index storage unit 
26 corresponds to such a table which records thereon 
index information of a CM program every CM broadcast- 
ing band. This index information implies a starting time 
Instant, a starting address, an end time instant, an end 
address, and a length. This table is formed on the RAM 
4. 

[0076] Returning back to Fig. 2, the reproducing man- 
agement unit 27 manages reproducing operations of 
broadcasting data stored in the buffer disk 21 based up- 
on CM index information and highlight index informa- 
tion. 

[0077] In other words, the reproducing management 
unit 27 manages both the highlight index information 
stored in the highlight index storage unit 25 and the CM 
index information stored in the CM index information 
storage unit 26. At a time instant when a CM broadcast 
is commenced, the reproducing management unit 27 
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detects the index information of the proper highlight 
scene from the highlight index storage unit 25, and sets 
the read address of the buffer disk 21 to the starting ad- 
dress which is written into the detected index informa- 
tion. 

[0078] The switch 28 switches the broadcast data in- 
putted from the tuner 18 and the broadcast data which 
is time-shifted and is supplied from the buffer disk 21 
under control of the reproducing management unit 27. 
[0079] While one end of the switch 28 is connected to 
the decoder 8a, any one of the broadcast data inputted 
from the tuner 1 8 and the broadcast data supplied from 
the buffer disk 21 is entered to this decoder 8a. The de- 
coder 8a decodes the entered broadcast data, and the 
decoded data is outputted from the display apparatus 
15. It should also be noted that the switch 28 need not 
be physically realized, but may be realized by way of a 
conceptional idea. When this switch 28 is realized in a 
software manner, this switch 28 may be realized by the 
internal condition judgement. In other words, this switch 
28 may be realizecieven by a mechanical switch, or an 
electronic switch. 

[0080] The reproducing management unit 27 per- 
forms the management of the reproducing operation in 
accordance with the below-mentioned sequential oper- 
ation. In other words, the reproducing management unit 
27 detects the proper index information from the high- 
light index storage unit 25 at such a time instant when 
the CM start sensing unit 23 senses the commencement 
of the CM broadcast. Subsequently, the reproducing 
management unit 27 sets the starting address of this in- 
dex to the data read position of the buffer disk 21 , and 
also switches the switch 28 to the switch side of the buff- 
er disk 21 . 

[0081] Thereafter, the reproducing management unit 
27 reads the broadcast data from the buffer disk 21- to 
supply the read broadcast data to the decoder 8a until 
the CM end sensing unit 26 senses the end of this CM 
broadcast. At such a time instant when the CM broad- 
cast is ended, the reproducing management unit 27 
switches the switch 28 to the switch side of the tuner 8a. 
As a result, while the CM program is broadcasted, the 
highlight scene data portion contained in the broadcast 
data recorded on the buffer disk 21 is supplied to the 
decoder 8a. 

[0082] Fig. 5 to Fig. 8 are flow charts for representing 
operations of the receiver 20 according to the first em- 
bodiment of the present invention. Fig. 5 is a flow chart 
for explaining operations of the receiver 20 when broad- 
cast data is received. Fig. 6 is a flow chart for explaining 
the content of the highlight analyzing process operation 
indicated in Fig. 5. Fig. 7(A) is a flow chart for explaining 
the content of the CM start index storage process oper- 
ation shown in Fig. 5. Fig. 7(B) is a flow chart for de- 
scribing the content of the CM end index storage proc- 
ess operation shown in Fig. 5. Fig. 8 is a flow chart for 
describing the content of the highlight selection process 
operation indicated in Fig. 5. 
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[0083] The process flow operation indicated in Fig. 5 
is commenced by initiating the tuner 1 8, the receiver 20, 
the decoder 8a. and also the display apparatus 1 5 by 
turning ON the power supplies thereof in order that an 
audience watches a broadcasting program outputted 
from the display apparatus 15. 

[0084] As indicated in Fig. 5, at a step S01 of this flow 
chart, the CM start sensing process operation is execut- 
ed. In other words, the CM start sensing unit 23 monitors 
the broadcast data supplied from the tuner 18, and judg- 
es as to whether or not a CM broadcast is commenced 
(step S02). At this time, when the CM broadcast is com- 
menced, this CM start sensing process is advanced to 
a step S06, whereas when the CM broadcast is not yet 
commenced, this sensing process operation is ad- 
vanced to another step S03. 

[0085] At this step S03, a subroutine of the highlight 
analyzing process operation is executed. In other 
words, as indicated in Fig. 6, the analyzing unit 22 ana- 
lyzes the broadcast data supplied from the tuner 18 
(step S031 ) so as to judge as to whether or not the high- 
light scene is commenced (step S032). At this time, the 
analyzing unit 22 stores a starting time instant of the 
highlight scene into the highlight index storage unit 25 
(step S033) when this analyzing unit 22 judges that the 
highlight scene is commenced (step S032; YES). Also, 
the analyzing unit 22 stores into the highlight index stor- 
age unit 25, a recording position (starting address) in 
the buffer disk 21 as to the broadcast data, which cor- 
responds to this starting time instant, and thereafter, the 
highlight analyzing process is accomplished. Subse- 
quently, the process operation is advanced to a step S04 
of Fig. 5. 

[0086] On the other hand, at the step S032. when the 
analyzing unit 22 judges that the highlight scene is not 
commenced (step S032; NO) , the analyzing unit 22 
judges as to whether or not the highlight scene is ended 
(step S035). When the analyzing unit 22 judges that the 
highlight scene is not yet ended (step S035; NO), the 
highlight analyzing process operation is ended, and the 
process operation is returned to the step S04 of Fig. 5. 
[0087] To the contrary, when the analyzing unit 22 
judges that the highlight scene is ended (step S035; 
YES), the analyzing unit 22 stores an end time instant 
of the highlight scene into the highlight Index storage 
unit 25 (step S036), and also stores both a recording 
position (end address) in th3 buffer disk 21 as to the 
broadcast data, which corresponds to this end time in- 
stant, and a length of the highlight scene into the high- 
light index storage unit 25 (step S037). Thereafter, the 
highlight analyzing process operation is accomplished, 
and then the process operation is advanced to the step 
S04 of Fig. 5. 

[0088] At the step S04, the broadcast program watch- 
ing process for the audience is performed. In other 
words, the broadcast program providing process oper- 
ation with respect to the audience is carried out. Con- 
cretely speaking, the broadcast data supplied from the 



* tuner 18 is supplied to the decoder 8a, both the image 
data and the speech data contained in the broadcast 
data are decoded, or demodulated by this decoder 8a, 
and then, the image (picture) and the speech (voice) 
5 corresponding to the decoded image data and the de- 
coded speech data are output from the display appara- 
tus 15. Thereafter, the process operation is advanced 
to a step SOS. 

[0089] At this step S05, the CPU judges as to whether 

10 or not the audience completes watching of the broad- 
cast program, namely, the operation capable of accom- 
plishing the process operation by the receiver 20 is ex- 
ecuted. As this accomplishing operation, for example, 
the power supply of the computer 1 (receiver 20) is 

is stopped, and the application program capable of realiz- 
ing the receiver 20 is completed. At this time, in the case 
that the process accomplishing operation is executed, 
the CM start sensing process operation shown in Fig. 5 
is ended. To the contrary, when the process accomplish- 

20 ing operation is not executed, this process operation is 
returned to the previous step S01 . 
[0090] On the other hand, at the step S06, a subrou- 
tine of the CM start index storage process operation is 
executed by that the CM start sensing unit 23 judges the 

25 commencement of the CM broadcast at the previous 
step S02. In other words, as indicated in Fig. 7(A), the 
CM start sensing unit 23 detects a starting time instant 
of this CM broadcast to store this detected starting time 
instant into the CM index storage unit 26 (step S061), 

30 and also stores a recording position (starting address) 
in the buffer disk 21 as to the broadcast data, which cor- 
responds to this starting time instant into the CM index 
storage unit 26 (step S062). Thereafter, the CM starting 
index storage process operation is completed, and then, 

35 the process operation is advanced to a further step S07 
of Fig. 5. 

[0091 ] At the step S07, a CM end sensing process op- 
eration is executed. That is, the CM end sensing unit 24 
monitors the broadcast data so as to judge as to whether 

40 or not the CM broadcast is completed (step SOS). At this 
time, when the CM end sensing unit 24 judges that the 
CM broadcast is ended (step S08; YES), the process 
operation is advanced to a step S1 4. To the contrary, 
when the CM end sensing unit 24 judges that the CM 

45 broadcast is not ended (step S08; NO), the process op- 
eration is advanced to a step S09. 
[0092] At this step S09, the reproducing management 
unit 27 judges as to whether or not the audience watch- 
es the highlight scene. In other words, the reproducing 

so management unit 27 judges as to whether or not the 
broadcast data recorded on the buffer disk 21 is sup- 
plied to the decoder 8a in the present stage. When the 
audience watches the highlight scene (step S09; YES), 
the process operation is advanced to a step S1 2, where- 

55 as when the audience does not watch the highlight 
scene (step S09; NO), the process operation is ad- 
vanced to a step S10. 

[0093] At the step S10, a subroutine of the highlight 
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selection process operation is carried out. In other 
words, as shown in Fig. 8, the reproducing management 
unit 27 selects proper index information from the index 
information stored in the highlight index information stor- 
age unit 25 (step S101). In this case, as an example, 
the index information is selected in the order of the latest 
starting time instant. It should also be noted that the in- 
dex information of the highlight scene may be selected 
in accordance with an arbitrary condition. 
[0094] Thereafter, the reproducing management unit 
27 seeks the read head of the buffer disk 21 at a starting 
address contained in the selected index information 
(step S102). As a consequence, such a condition may 
be established that the reproducing operation is com- 
menced from the starting address of the highlight scene. 
Thereafter, the highlight selection process operation is 
ended, and the process operation Is advanced to a step 
S11 of Fig. 5. 

[0095] At the step S1 1 , the reproducing management 
unit 27 switches the switch 28 from the switch side of 
the tuner 1 8 to the switch side of the buffer disk 21 . As 
a consequence, the broadcast data which are sequen- 
tially read out from the starting address of the highlight 
scene are supplied to the decoder 8a. Thereafter, the 
process operation is advanced to a step S12. 
[0096] At this step S12, both pictures (images) and 
speech (voice) are outputted from the display apparatus 
15, which are produced based upon the broadcast data 
decoded by the decoder 8a. As a consequence, the au- 
dience can watch the highlight scene recorded on the 
buffer disk 21 . Thereafter, the process operation is ad- 
vanced to a step S13. 

[0097] Atthe step S1 3, similarto the above-described 
step SOS, it is judged as to whether or not the audience 
stops watching the broadcast program. When the audi- 
ence stops watching the broadcast program, the proc- 
ess operation of Fig. 5 is ended. To the contrary, when 
the audience is still watching the broadcast program : the 
process operation is returned to the previous step S07. 
[0098] On the other hand, in such a case that it is so 
judged at the step S08 that the CM broadcast is ended 
and then the process operation is advanced to a step 
S14, a CM end index storage process operation is car- 
ried out. In other words, as shown in Fig. 7(B), the CM 
end sensing unit 24 stores an end time instant of the CM 
broadcast into the CM index storage unit 26 (step S063), 
and also stores into this CM index storage unit 26, both 
a storage position (end address) in the buffer disk 21 as 
to the broadcast data corresponding to this end time in- 
stant, and further, a length of this CM broadcast (step 
S064). As a result, the CM end index storage process 
operation is accomplished, and the process operation 
is advanced to a step S15 of Fig. 5. 
[0099] At the step S1 5, the reproducing management 
unit 27 switches the switch 28 from the switch side of 
the buffer disk 21 to the switch side of the tuner 18. This 
may cause such a condition that the broadcast data en- 
tered from the tuner 1 8 is supplied to the decoder 8a, 



so that the program watching mode is set. That is, the 
audience watches the broadcast program in real time. 
Thereafter, the process operation is advanced to the 
above-described step S03. 

5 [0100] In the flow chart of Fig. 5, after the highlight 
analyzing process operation defined atthe step S03 has 
been carried out, the program watching operation de- 
fined at the step S04 is executed in this order. Alterna- 
tively, the process sequence order of the steps S03 and 

io S04 may be carried out in such an order opposite to the 
above-explained order. 

[01 01 ] Also, the process operation defined at the step 
S11 (switching process operation of switch 28) may be 
carried out at any process steps defined after the com- 

*s mencement of the CM broadcast is sensed and up to 
such a time instant when the data corresponding to the 
highlight scene is actually commenced to be processed. 
Also, in the case that the switch 28 has already been 
switched, no specific process operation needs to be per- 

20 formed. 

[0102] Fig. 9 is ajiagram for indicating a relationship 
between a write address and a read address in the buff- 
er disk 21 employed in the receiver 20 according to the 
first embodiment. In Fig. 9, there are indicated that at a 

25 CM broadcast starting time instant, a starting address 
corresponding to a starting time instant of a highlight 
scene is sought, whereas at a CM broadcast ending 
time instant, the present address is returned to a posi- 
tion of a received broadcast program (starting address 

30 becomes address before being sought). 

[01 03] In Fig. 9, this relationship indicates such a case 
that a length of a highlight scene contained in a com- 
mercial broadcast "CM1" is made longer than a CM 
broadcasting time range. In this case, when the CM 

35 broadcast is ended, the watching position is returned to 
the real-time watching position. 

[0104] Another commercial broadcast M CM2" shows 
an example where two pieces of highlight- scenes are 
inserted into a single broadcasting time range. The high- 

40 light scenes are reproduced in the order of the latest 
starting time instant. As previously explained, when the 
reproducing operation of a certain highlight scene con- 
tained in the CM broadcast is accomplished, another 
highlight scene is selected and reproduced until the end 

45 of the CM broadcast Is sensed. 

[0105] In accordance with the receiver 20 of this first 
embodiment, only such a data portion (broadcast data) 
of a broadcast program defined by a constant (prede- 
termined) time duration is stored into the buffer disk 21 , 

50 and this broadcast program is provided via the receiver 

20 to an audience. A highlight scene is detected from 
the broadcast data stored in this buffer disk 21 , and both 
a starting address and an end address in the buffer disk 

21 as to this detected highlight scene are saved. 

55 [0106] Thereafter, in such a case that the audience 
watches a broadcast program in real time (program 
watching mode) , when a CM broadcast is commenced, 
the broadcast data of the highlight scene stored in the 
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buffer disk 21 is read based on both the saved starting 
address and the saved end address, and then, the read 
broadcast data is reproduced. As a result, both the pic- 
ture and the speech produced based upon this highlight 
scene broadcast data are supplied to the audience 5 
(highlight watching mode) . Then, either a single piece 
or plural pieces of highlight scenes may be provided to 
the audience until the end of this CM broadcast is 
sensed. 

[01 07] Thereafter, when the end of this CM broadcast 
is sensed, both a picture (image) and speech (voice) 
produced based on broadcast data acquired from the 
tuner 18 are provided to the audience. In other words, 
the present highlight watching mode is switched back to 
the program watching mode, so that the audience may 
watch the broadcast program in real time. 
[0108] As a consequence, while the CM program is 
being broadcasted (either CM broadcasting time range- 
within program or CM broadcasting time range between 
programs), the audience can watch the highlight scenes 
recorded on the buffer disk 21 . 

[01 09] In accordance with the first embodiment, at the 
time when the CM broadcast is commenced, the audi- 
ence can automatically watch such a program one more 
time, which has been watched so far, so that such use- 
less operation as zapping operation executed while the 
CM program is broadcasted is no longer required. Also, 
since the highlight scene of the broadcast program is 
reproduced, it is possible to avoid such a fact that the 
audiences will lose their concentration and their inter- 
ests to the broadcast program. Therefore, the audienc- 
es can further enjoy watching the program, as compared 
with that of the conventional broadcast receiver. Further, 
since the highlight scenes are automatically repro- 
duced, this broadcast receiver can eliminate cumber- 
some operations of replay designations by the audienc- 
es. 

[SECOND EMBODIMENT] 

[0110] Fig. 10 is a functional block diagram of a re- 
ceiver 20A according to a second embodiment of the 
present invention. It should be noted that the receiver 
20A of this second embodiment may be realized by em- 
ploying the hardware structure (see Fig. 38) as ex- 
plained in the above-explained first embodiment, and 
the functional block of Fig. 1 0 is substantially the same 
as that of the first embodiment, except that a highlight 
tag analyzing unit 22A (will be referred to as an "analyz- 
ing unit 22A" hereinafter) is provided instead of the high- 
light scene analyzing unit 22 employed in the first em- 
bodiment. 

[01 11 ] The analyzing unit 22A interprets tag informa- 
tion (equal to index) corresponding to a highlight scene 
previously inserted into the broadcast data. In other 
words, while a broadcast station previously inserts spe- 
cific tag information into a user area of broadcast data 
and then transmits the tag- inserted broadcast data, 



22 

since the highlight tag analyzing unit 22A interprets the 
inserted tag from the received broadcast data, both a 
starting position and an end position of the highlight 
scene can be grasped which is designated on the side 
of the broadcast station. 

[0112] A highlight index sorts highlight scenes inter- 
preted by tags in the temporal order, and a data structure 
of a highlight index storage unit 25 is similar to that of 
the first embodiment. 

[0113] Although operations of the receiver 20A ac- 
cording to the second embodiment are substantially 
equal to those of the first embodiment (see Fig. 5), this 
receiver 20A owns such a different operation in the con- 
tent of the highlight analyzing process operation step 
(step S03) by the analyzing unit 22A. In other words, in 
the receiver 22A of the second embodiment, instead of 
the operations defined in the flow chart of Fig. 6, this 
receiver 22A is operated in accordance with a highlight 
analyzing process operation shown in Fig. 11 according 
to the second embodiment. 

[0114] In Fig. 1"L at a step S201, the analyzing unit 
22A executes a highlight tag analyzing process opera- 
tion and then, analyzes/judges as to whether or not a 
tag indicative of a highlight scene is contained in broad- 
cast data (step S202). 

[0115] At this time, as a result of analysis, when the 
analyzing unit 22 A detects such a tag indicative of a 
commencement of this highlight scene (step S202; 
YES) , this analyzing unit 22A stores as a highlight index 
into the highlight storage unit 25, both a starting time 
instant of the highlight scene corresponding to this tag 
and also a position (starting address) corresponding to 
this starting time instant as to the buffer disk 21 (steps 
S203 and S204). 

[0116] Also, in the case that the analyzing unit 22A 
detects such a tag indicative of an end of the highlight 
scene (step S205; YES) , this analyzing unit 22A wites 
into the relevant positions of the highlight index storage 
unit 25, both an end time instant of the highlight scene 
corresponding to this tag and also a position (end ad- 
dress) corresponding to this end time instant as to the 
buffer disk 21 (steps S206 and S207). 
[0117] Similar to the first embodiment, subsequently, 
when a CM broadcast is commenced, the reproducing 
management unit 27 may provide the highlight scene 
recorded on the buffer disk 21 to the audience instead 
of the CM broadcast, in accordance with the highlight 
scene index. 

[0118] In this second embodiment, while the broad- 
casting station previously multiplexes the tag informa- 
tion on the data of the broadcast program to broadcast 
the multiplexed broadcast data with such tag informa- 
tion functioning as the index indicative of the highlight 
scene, the receiver 20A interprets this tag information 
to detect the highlight scene indicated by the tag infor- 
mation, and then reproduces the highlight scene while 
the CM program is broadcasted. 
[0119] Similar to the above-explained first embodi- 
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ment, as a consequence, the audience can automatical- 
ly watch such a program, which has been so far 
watched, at the time when the CM broadcast is com- 
menced. Furthermore, the receiver 20A need'not detect 
the highlight scene by executing the image recognition 5 
process operation and the speech recognition process 
operation, but also the highlight scene intentionally des- 
ignated by the broadcast station can be supplied to the 
audience, so that the audience can enjoy watching of 
the broadcast program. 

[THIRD EMBODIMENT] 

[0120] Fig. 12 is a functional block diagram of a re- 
ceiver 20B according to a third embodiment of the 
present invention. It should be noted that the receiver 
20B of this third embodiment may be realized by em- 
ploying the hardware structure (see Fig. 38) as ex- 
plained in the above-explained first embodiment, and 
the functional block of Fig. 12 is substantially same as 
that of the first embodiment, except that a replay subject 
automatic judging unit 22 B (will be referred to as a "judg- 
ing unit 22B" hereinafter) is provided instead of the high- 
light scene analyzing unit 22, a replay subject index stor- 
age unit 25B is employed instead of the highlight index 
storage unit 25, and furthermore, an input device 31 is 
newly employed. 

[0121] The input device 31 may be arranged by em- 
ploying the keyboard 1 6 and the mouse 1 7 indicated in 
Fig. 38. Also, the input device 31 may be arranged by 
using a remote controller 32. Alternatively, the input de- 
vice 31 may be arranged by a microphone and a speech 
recognizing apparatus. This microphone is used to in- 
struct the receiver 20B by a speech manner. 
[0122] In the third embodiment, the remote controller 
32 is employed as this input device 31 . Fig. 13 is a dia- 
gram for indicating an example of this remote controller 
32. The remote controller 32 is arranged in such a way 
that a designation button 33 is provided with the con- 
ventional television remote controller. This designation 
button 33 (subject to be replayed later) is exclusively 
used to designate a replay subject. When an audience 
again wishes to watch a scene (namely, audience judg- 
es this scene as a highlight scene) while a broadcast 
program Is watched, If the audience depresses this des- 
ignation button 33, then this audience may watch such 
a scene corresponding to the) designated replay subject 
(highlight scene) during the subsequent CM broadcast- 
ing time. 

[0123] In such a case that the audience designates 
the relay subject by using the input device 31 (by press- 
ing designation button 33), the judging unit 22B auto- 
matically judges the replay subject in accordance with 
this designation. 

[0124] For instance, the judging unit 22 B sets posi- 
tions as a replay subject, which are defined from one 
position corresponding to a time instant preceding to 
such a time instant when a designation is received by a 



predetermined time duration up to another position cor- 
responding to the time instant when the designation is 
received. Alternatively, the judging unit 22B may set as 
a replay subject, a predetermined time duration before/ 
after a designated time instant as a center. Also, the 
length of the replay subject may be selected to be a fixed 
length, or may be changed by the audience manipulat- 
ing the input device 31 . 

[0125] Then, the judging unit 22B acquires a starting 
time instant of the replay subject, a starting address 
thereof; an end time instant of the replay subject, and 
an end address thereof. This judging unit 22B stores 
these acquired items into the replay position index stor- 
age unit 25B. 

[0126] The replay position index storage unit 25B 
stores the starting time instant of the replay subject, the 
starting address thereof, the end time instant of the re- 
play subject, and the end address, which are acquired 
by the judging unit 22B, in a table form for every replay 
subject. A data structure of the replay position index 
storage unit 25B isidentical to that of the highlight index 
storage unit 25 shown in Fig. 3. 

[0127] Operations of the receiver 20B according to 
the third embodiment are substantially equal to those of 
the first embodiment (see Fig. 5). There is only such a 
different operation, namely a content of a highlight an- 
alyzing process operation (step S03) executed by the 
judging unit 22B. In other words, in accordance with the 
receiver 20 B of this third embodiment, operations are 
executed in accordance with such a highlight analyzing 
process operation shown in Fig. 14 : instead of the proc- 
ess operation of the flow chart indicated in Fig. 6. 
[0128] While a broadcast program is received, in the 
case that a designation of a replay subject from an au- 
dience is entered into the receiver 20B by manipulating 
the input device 31 (step S301 ; YES) , the judging unit 
22B automatically judges the replay subject based upon 
a time instant when the designation is received (step 
S302). - ... 

[0129] Subsequently, the judging unit 22B stores both 
a starting time instant of the replay subject and also an 
end time instant thereof into the subject index storage 
unit 25B (step S303), and also stores into this replay 
subject index storage unit 25B, both a starting address 
of this replay subject and an end address thereof as to 
the buffer disk 21 (step S304). 

[01 30] The subsequent operation of this receiver 20B 
is substantially equal to that of the first embodiment. In 
such a case that the commencement of the CM broad- 
cast is detected, the reproducing management unit 27 
reads out a proper replay subject index from the replay 
subject index storage unit 25B, and then, reads out 
broadcast data corresponding to this read replay subject 
index from the buffer disk 21 to supply the read broad- 
cast data to the decoder 8a. As a result, in the CM broad- 
cast time range, both the picture and the speech, which 
correspond to the replay subject (highlight scene) des- 
ignated by the audience, may be supplied instead of the 
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CM broadcast program. 

[0131] Similar to the first embodiment, in accordance 
with the third embodiment, since the highlight scene is 
reproduced during the CM broadcast time, both the 
problem occurred while the CM program is watched and 
the problem of the zapping operation can be solved at 
the same time. Furthermore, since the replay subject 
wanted by the audience is registered as the highlight 
scene, the audience can more deeply enjoy watching 
the broadcast program. 

[FOURTH EMBODIMENT] 

[0132] Next, a description is made of a fourth embod- 
iment according to the present invention. A receiver of 
this fourth embodiment owns such an arrangement ca- 
pable of solving the below-mentioned problems. 
[0133] In the first to third embodiments, in the case 
that length of the highlight scene is longer than the 
length of the CM program, the reproducing operation of 
the highlight scene is automatically accomplished at the 
time instant when the end of this CM program is sensed, 
and then, the highlight scene watching mode is returned 
to the program watching mode. As a result, the first to 
third embodiments cannot satisfy such a requirement 
made by the audience that this audience wishes to con- 
tinuously watch the highlight scene. 
[0134] Since both a hardware construction and a 
functional block of the receiver according to the fourth 
embodiment are similar to those of the above-explained 
first embodiment (see Fig. 1 and Fig. 2), explanations 
of these hardware construction/functional block are 
omitted. It should be understood that the operation of 
the receiver according to the fourth embodiment is dif- 
ferent from that of the first embodiment. 
[0135] Fig. 15 is a flow chart for explaining operation 
of the receiver 20 according to the fourth embodiment. 
This receiver operation of the fourth embodiment is dif- 
ferent from the receiver operation (see Fig. 5) of the first 
embodiment as follows. 

(1) The execution order of both the condition judg- 
ment (step S08) for judging the end of the CM 
broadcast and the condition judgment (step S09) 
made while the highlight scene Is watched is re- 
versed, ad compared with that of the first embodi- 
ment (see steps S408 and S409). 

(2) When the end of the CM broadcast is detected 
(step S409; YES), the address of the CM end posi- 
tion is sought (step S415) and the present mode is 
advanced to an offset watching mode (step S404). 

[0136] In other words, in the first embodiment, when 
the end of the CM broadcast is sensed, the highlight 
scene watching mode is immediately advanced to the 
program watching mode (step S04 of Fig. 5). To the con- 
trary, in the receiver of the fourth embodiment, the high- 
light scene watching mode is not advanced to the pro- 



gram watching mode until the reproducing operation of 
the highlight scene is accomplished which is being re- 
produced during the CM broadcasting operation. 
[01 37] As a consequence , in such a case that a length 

5 of a highlight scene reproduced in the CM broadcast 
time range is longer than this CM broadcast time range, 
when the end position of the CM broadcast is returned 
after the highlight scene has been watched, the present 
watching mode is brought into an offset watching mode 

10 delayed by preselected time from the program watching 
mode (real time watching mode). 
[01 38] Fig. 1 6 is a diagram for indicating a relationship 
between a write address and a read address to the buff- 
er disk 21 in the receiver 20 of the fourth embodiment. 

15 in Fig. 1 6, when a CM program starts to be broadcasted, 
a starting address of a highlight scene is sought and 
thus, the sought highlight scene is reproduced. 
[0139] Thereafter, in such a case that the reproducing 
operation of the highlight scene is not yet accomplished 

20 even at the time instant when the CM broadcast is end- 
ed, the present watching mode is returned to the CM 
end position after this highlight scene is accomplished. 
Thereafter, the offset watching mode is continued until 
a commencement of a next CM broadcast is sensed. 

25 This operation is indicated between the CM broadcast 
"CM1" and the CM broadcast M CM2" shown in Fig. 16. 
As apparent from this drawing, there is a time delay from 
the real time watching operation. 
[0140] Similar to the program watching mode, in such 

30 a case that a commencement of a CM broadcast is 
sensed during the offset watching mode, a highlight 
scene is sought. When the highlight scene is ended, the 
present watching mode is returned to the CM end posi- 
tion. This fact is represented as a portion related to the 

35 commercial "CM2" in Fig. 16. 

[0141] In accordance with the receiver of the fourth 
embodiment, when the CM broadcast is ended, the 
present watching mode is not immediately returned to 
the original broadcasting operation, but the reproducing 

40 operation is commenced from the CM end position of 
the original broadcasting operation after the highlight 
scene has been accomplished, while using the principle 
idea of the offset watching mode of the time shift watch- 
ing operation. As a consequence, even when the length 

45 of the highlight scene is long, the audience can contin- 
uously watch the program without receiving any stress. 

[FIFTH EMBODIMENT] 

so [0142] Next, a description is made of a fifth embodi- 
ment according to the present invention. A receiver of 
this fifth embodiment owns such an arrangement capa- 
ble of solving the below-mentioned problems. 
[0143] In a television broadcasting program such as 

55 movies, for an audience to have a clear recognition of 
a movie story, a CM program is not inserted into this 
movie television broadcasting program for a preselect- 
ed time after this broadcasting program is commenced. 
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However, since a time duration required to broadcast 
CM programs is determined based upon a contract, 
these CM programs are concentrately broadcasted in a 
rear half portion of a broadcast program. As a result, 
while interests of the audience become emphasized in 
this rear half program portion, the CM programs are fre- 
quently broadcasted, so that this audience may feel 
strong stress while this audience watches the movie on 
television. 

[0144] Since both a hardware construction and a 
functional block of the receiver according to the fifth em- 
bodiment are similar to those of the above-explained 
first embodiment (see Fig. 1 and Fig. 2), explanations 
of these hardware construction/functional block are 
omitted. Also, similar to the fourth embodiment, in the 
receiver of this fifth embodiment, when a CM broadcast 
Is accomplished while a highlight scene is reproduced, 
after the reproducing operation of the highlight scene Is 
ended, the offset watching mode is commenced (see 
Fig. 15). 

[0145] It should be understood that the operation of 
the receiver according to the fifth embodiment is differ- 
ent from that of the fourth embodiment. That is, the re- 
producing time of the highlight scene which is provided 
to the audience while the CM program is broadcasted 
is always made longer than the CM broadcasting time. 
As a result, in the CM broadcasting time range which is 
inserted into the rear half portion of the broadcast pro- 
gram, a time difference between a real time watching 
operation and an offset watching operation (time differ- 
ence between broadcasting time instant and reproduc- 
ing time instant in television broadcasting operation) 
may become longer than the CM broadcasting time. As 
a consequence, the audience can watch this television 
broadcasting program under such a condition that the 
CM broadcast is completely cut from this television 
broadcasting program. 

[0146] Fig. 17 is a diagram for indicating a relationship 
between a write address and a read address to the buff- 
er disk 21 in the receiver 20 of the fifth embodiment. In 
Fig. 17, when a CM program starts to be broadcasted, 
a starting address of a highlight scene is sought and 
thus, the sought highlight scene is reproduced. At this 
time, the present watching operation is returned to the 
end position of the CM broadcast. 
[01 47] In this embodiment, the reproducing time of the 
highlight scene is made slightly longer, and this highlight 
scene is inserted to a front half portion of a broadcast 
program and is reproduced while a CM program is 
broadcasted. As a result, in the CM broadcasting time 
range which is inserted into a rear half portion of the 
broadcast program, the time difference between the real 
time watching operation and the offset watching opera- 
tion is prolonged. As a result, in the CM broadcasting 
time range of the program rear half portion, even when 
the highlight scene is not reproduced, the CM broad- 
casting operation can be cut. This fact is indicated as a 
portion of a commercial program °CM3" and a portion 



of a commercial program "CM4 M indicated in Fig. 17. 
[0148] In accordance with the fifth embodiment, the 
length of the highlight scene is continuously prolonged 
and inserted in the CM broadcast time in the front half 

5 portion of the program, whereas no highlight scene is 
inserted in the CM broadcast time in the rear half portion 
of this program. As a result, as the program proceeds 
to the real half portion, the time difference between the 
original program broadcast and the actually watched 

10 scenes will become longer. This time is allocated to the 
CM broadcast time in the rear half portion of the pro- 
gram, and may be used so as to cut the CM program. 
[01 49] As a consequence, in such a case that the au- 
dience watches such a program having a story such as 

15 movies and TV dramas on the television, this audience 
can be released from the CM programs which are fre- 
quently inserted into the rear half portion of the program , 
and therefore, can watch a climax portion of this pro- 
gram without interruptions of the CM programs. As a re- 

20 suit, the audience can watch this broadcast program 
with his satisfaction 

[SIXTH EMBODIMENT] 

25 [0150] Next, a description is made of a sixth embodi- 
ment according to the present invention. Since both a 
hardware construction and a functional block of a receiv- 
er according to the sixth embodiment are similarto those 
of the above-explained first embodiment (see Fig. 1 and 

30 Fig. 2), explanations of these hardware construction/ 
functional block are omitted. 

[0151] It should be understood that the operation of 
the receiver according to the sixth embodiment is differ- 
ent from that of the first embodiment as to such a point 

35 that a program digest is used as a highlight scene. This 
program digest implies that highlight scenes contained 
in a broadcast program, and acquired from a time instant 
when a preceding CM broadcasting time range is ended 
up to another time instant when a present CM broad- 

40 casting program is commenced (CM broadcasting time 
range) are coupled to each other without deteriorating 
a flow of a story. 

[0152] The program digest may be formed in such a 
manner that the reproducing management unit 27 re- 
4s produces a plurality of highlight scenes detected by the 
analyzing unit 22 in accordance with, for instance, the 
below-mentioned method. 

(1 ) In such a case that a plurality of highlight scenes 
so are detected by the analyzing unit 22 from a pro- 
gram during a CM broadcasting time range, and the 
present CM broadcast is commenced, the repro- 
ducing management unit 27 reproduces a plurality 
of detected highlight scenes in a time sequential 

55 manner by equally increasing a reproducing speed. 

(2) While the analyzing unit 22 detects, for example, 
a scene where actors speak many lines as a plural- 
ity of highlight scenes from broadcast data in a pro- 
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gram during a CM broadcasting time range, the re- 
producing management unit 27 continuously repro- 
duces a plurality of detected highlight scenes when 
a CM broadcast is commenced. 

[0153] It should also be noted that if a content of a 
program during a CM broadcast time range is used and 
also a story of this program content is not deteriorated, 
then this program digest may be edited in any way. 
[01 54] Fig. 1 8 is a diagram for indicating a relationship 
between a write address and a read address to the buff- 
er disk 21 in the receiver 20 of the sixth embodiment. In 
Fig. 1 8, a grey meshed portion indicates such a fact that 
a program digest is reproduced, and this program digest 
is related to such a program which has been broadcast- 
ed in the CM broadcasting time range immediately be- 
fore in each of the CM broadcasting time ranges. 
[01 55] For example , in a CM broadcasting time range 
of "CM2", a program digest is provided to an audience. 
This program digest is related to a content of a program 
defined from a time instant when "CM1" is completed 
until "CM2" is commenced, which correspond to a CM 
broadcasting time range before this "CM 2". Thereafter, 
when the end of this CM broadcast is sensed, the repro- 
duction of the program digest is ended, and then, the 
present watching mode is advanced to the program 
watching mode. 

[0156] In accordance with the sixth embodiment, as 
the highlight scene, such a program digest is repro- 
duced, which is acquired for a time duration defined from 
a position where the preceding CM is inserted until the 
present CM is commenced. As a consequence, when 
the audience watches such a program having a story 
such as movies and dramas, this audience can confirm 
a rough outline of this story during the CM broadcasting 
time, and can again confirm the content of the program 
in such a case that the audience has not grasped the 
content of this story. Since the program digest is auto- 
matically displayed during the CM broadcasting time, 
this program digest display may give very large merits 
to the user. 

[SEVENTH EMBODIMENT] 

{0157] Next, a description is made of a seventh em- 
bodiment according to the present invention. Since both 
a hardware construction and a functional block of a re- 
ceiver according to the seventh embodiment are similar 
to those of the above-explained first embodiment (see 
Fig. 1 and Fig. 2), explanations of these hardware con- 
struction/functional block are omitted. It should be un- 
derstood that the operation of the receiver according to 
the seventh embodiment is different from that of the first 
embodiment as to such a point that a CM broadcast pro- 
gram portion of a CM broadcast program, which is tem- 
porally returned (retraced) back from a starting time in- 
stant of this CM broadcast program by a constant time 
period, is used as a highlight scene. 



* [0158] For example, in the case that a CM broadcast- 
ing time range contained in a broadcast program is 2 
minutes, the analyzing unit 22 detects a program portion 
of a CM broadcast program as a highlight scene, and 
5 this program portion is temporally returned back from a 
starting time instant of this CM broadcast program by 2 
minutes. Then, the analyzing unit 22 records a highlight 
index (staring address, end address, etc.) of this high- 
light scene on the highlight index storage unit25. There- 
to after, when the commencement of the CM broadcast is 
sensed, the reproducing management unit 27 reproduc- 
es this program portion in accordance with the highlight 
index. 

[0159] Thereafter, when the CM end sensing unit 24 

15 senses an end of this CM broadcast, the reproducing 
management unit 27 switches the present watching 
mode to the program watching mode. As a conse- 
quence, the audience can watch the broadcast program 
under such a condition that the CM broadcast program 

20 has been cut out from this program. 

[0160] Fig. 1 9 is a. diagram for indicating a relationship 
between a write address and a read address to the buff- 
er disk 21 in the receiver 20 of the seventh embodiment. 
InFig. 19, whenaCM program starts to be broadcasted, 

25 such a fact is indicated that an address retraced for a 
length of a CM broadcasting time range is sought. 
[01 61 ] Also, there is shown such a fact in Fig. 1 9, that 
at a time instant when an end of a CM broadcast is 
sensed, the present watching mode is advanced to the 

30 program watching mode, and then, an audience watch- 
es a program in real time. This may achieve the same 
effect in the case that the audience watches the program 
from which the CM broadcast is cut out. 
[0162] In accordance with the seventh embodiment, 

35 as the highlight scene, the CM program portion is repro- 
duced, which is retraced from the broadcast program 
just before the CM program is commenced only by a 
previously-designated time duration. As a result, when 
the audience watches such a program having a story 

40 such as movies and dramas, the audience can contin- 
uously watch this program without the story being inter- 
rupted by the CM program, which is very useful for the 
audience. 

45 [EIGHTH EMBODIMENT] 

[0163] Next, a description is made of an eighth em- 
bodiment according to the present invention. Since both 
a hardware construction and a functional block of a re- 

so ceiver according to the eighth embodiment are substan- 
tially similar to those of the above-explained first em- 
bodiment (see Fig. 1 and Fig. 2), explanations of these 
hardware construction/functional block are omitted. It 
should be understood that the operation of the receiver 

55 according to the eighth embodiment is different from that 
of the first embodiment. That is to say, while the analyz- 
ing unit 22 applies weight with respect to a plurality of 
detected highlight scenes, the reproducing manage- 
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ment unit 27 changes a reproducing speed in response 
to a weight of a highlight scene. 
[0164] Fig. 20 is an explanatory diagram for explain- 
ing a data structure of a highlight index storage unit 25H 
employed in the receiver of the eighth embodiment. In 
Fig. 20, this highlight index storage unit 25H saves 
thereinto, every highlight scene, the weighing values 
(importance degrees: in this example, any value of 1 to 
10) of the highlight scenes calculated by the analyzing 
unit 22 in addition to the starting address, the starting 
time instant, the end address, the end time instant, and 
the length of the highlight scene, which are explained in 
connection with the first embodiment. 
[0165] The analyzing unit 22 performs the weighing 
operation in accordance with the below-mentioned 
manner, for example. That is, in such a scene that a 
screen owns small movement, the analyzing unit 22 sets 
the weight of the highlight scene to a small weight value. 
The reason resides in that even when the screen is fed 
in a fast speed, since a change in the screens is small, 
the audience can easily trace the story. To the contrary, 
in such a scene that a screen owns strong movement, 
the analyzing unit 22 sets the weight of the highlight 
scene to a large weight value. The reason resides in that 
when the screen is fed in the fast speed in such a scene 
where the movement thereof is strong, it is conceivable 
that the audience cannot grasp the story. Also, in such 
a case that the weighting operation is carried out by way 
of the speech (voice) manner for example, the analyz- 
ing unit 22 sets the small weighting value in such a 
scene where the actor's lines are few, whereas the an- 
alyzing unit 22 sets the large weighting value in such a 
scene where the actor's lines are numerous. Alterna- 
tively, the analyzing unit 22 may set the weighing value 
by combing these parameters. 

[01 66] Fig. 21 is a diagram for indicating a relationship 
between a write address and a read address to the buff- 
er disk 21 in the receiver 20 of the eighth embodiment. 
In Fig. 21 , as the highlight scene to be reproduced in the 
CM broadcasting time range, the weighted scene is 
used. The highlight scene whose importance degree is 
low is reproduced in the fast feeding mode, whereas the 
highlight scene whose importance degree is high is re- 
produced in the slow feeding mode. 
[0167] It should also be noted that the above-de- 
scribed arrangement of the receiver of this eighth em- 
bodiment may be substituted by the below-mentioned 
arrangement. That is, as explained in the second em- 
bodiment, while both a tag and such data indicative of 
an importance degree may be added to broadcast data 
on the side of a broadcast station, the data indicative of 
the importance degree may be detected by the analyz- 
ing unit 22 on the side of the receiver. Alternatively, as 
explained in the third embodiment, while an audience 
may designate an importance degree by employing the 
input device 31, the analyzing unit 22 may detect the 
designated importance degree. 
[0168] In the eighth embodiment, an image is provid- 



ed to the audience, in which the reproducing speed is 
changed in response to the importance degree of the 
highlight scene. As a consequence, the audience can 
confirm the detailed portion of the important scene by 

5 way of the slow reproducing operation. Conversely, the 
audience can watch such a scene having a low impor- 
tance degree by way of the fast-feed reproducing oper- 
ation. Accordingly, the audience can watch the impor- 
tant portion in detail, while grasping the entire story to 

10 some extent. 

[NINTH EMBODIMENT] 

[0169] Next, a description is made of a ninth embod- 

*5 iment according to the present invention. A receiver of 
this ninth embodiment owns such an arrangement ca- 
pable of solving the below-mentioned problems. 
[0170] In the case that a prize contest source of gifts 
is displayed to audiences in a broadcast program, this 

20 prize contest source is normally displayed only for sev- 
eral seconds. As a^onsequence, it is practically difficult 
for audiences to completely write this prize contest 
source on a memorandum and the like . As a conse- 
quence, the audiences memorize this prize contest 

25 source and thereafter write the memorized prize contest 
source on paper, or several audiences try to partially 
memorize this prize contest source, and thereafter, fi- 
nally construct the complete prize contest source. To 
avoid such a difficulty, one broadcast receiver is com- 

30 mercially available and is equipped with such a function 
that one frame contained in a broadcast program is cap- 
tured as a still image on a separate window. 
[0171] However, in this type of broadcast receiver, 
when such a still image as a destination address dis- 

35 played on the separate window becomes unnecessary, 
this still image must be discarded. This still picture dis- 
carding operation must be carried out in a manual man- 
ner. Also, since the still image is displayed on the sep- 
arate window, this still image must be4ocated on the up- 

40 permost position on the display screen, or the display 
screen must be changed. Furthermore, in such a case 
that the still image is displayed in a reducing size mode, 
resolution of the characters is decreased. There is such 
a drawback that these characters can be hardly read by 

45 the audiences. 

[0172] Since both a hardware construction and a 
functional block of a receiver according to the ninth em- 
bodiment are substantially similar to those of the above- 
explained first embodiment (see Fig. 1 and Fig. 2). It 

50 should be understood that the operation of the receiver 
according to the ninth embodiment is different from that 
of the first embodiment as to such a technical point that 
the reproducing management unit 27 provides a still im- 
age of one scene contained in a broadcast program as 

55 a highlight scene to an audience . 

[0173] Fig. 22 is a diagram for indicating a relationship 
between a write address and a read address to the buff- 
er disk 21 in the receiver 20 of the ninth embodiment. In 
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Fig. 22, in accordance with this ninth embodiment, one 
scene within a broadcast program is displayed by a stilt 
image as a highlight scene which is reproduced in a CM 
broadcasting time range . When the ending of the CM 
broadcast is sensed, the present watching mode is re- 
turned to the program watching mode. 
[0174] As the still image to be reproduced, for in- 
stance, a prize contest source displayed in a broadcast 
program may be used. The scene of this prize contest 
source is detected as the highlight scene by the analyz- 
ing unit 22, and the reproducing management unit 27 
reproduces this highlight scene in the CM broadcasting 
time range, so that the audiences can correctly write 
down the prize contest source. 

[0175] In accordance with the ninth embodiment, as 
the highlight scene, a plurality of frames (at least one 
frame) contained in the broadcast program can be uti- 
lized by scanning the frames. As a result, the destination 
address of the prize contest for the audiences, which is 
displayed in the broadcast program, can be correctly 
written down on memorandums and the like, while using 
the CM broadcasting time range, so that the audiences 
can effectively utilize their own time. 
[01 76] It should also be noted that the method for de- 
tecting the highlight scene provided as the still image 
may be realized by employing either the detecting meth- 
od of the second embodiment or the third embodiment. 
[0177] Alternatively, the receiver of the ninth embod- 
iment may be equipped further with a means for notify- 
ing an end of a CM broadcast to audiences in such a 
case that the end of this CM broadcast is sensed. In this 
alternative case, the following selection may be made. 
That is, while the destination address is being written 
down, when the CM broadcast is completed, the still im- 
age may be continuously watched by the audiences, or 
the original broadcast program may be again watched 
by the audiences. Therefore, such concern that the au- 
diences must write down the destination address by the 
CM broadcast is ended may be lessened. 

[TENTH EMBODIMENT] 

[0178] Subsequently, a tenth embodiment of the 
present invention will now be described. Fig. 23 is a 
functional block diagram for showing a receiver 20J ac- 
cording to the tenth embodiment. As indicated in Fig. 
23, in the receiver of the tentTi embodiment, a reproduc- 
ing management unit 27J is different from the above- 
explained reproducing management unit 27 of the first 
embodiment. 

[0179] In other words, since this reproducing man- 
agement unit 27J switches speech (voice) modes when 
the highlight scene watching mode is selected and the 
program watching mode is selected, the reproducing 
management unit 27J instructs the decoder 8a to switch 
these speech modes, if required. That is to say, the re- 
producing management unit 27J may function as a 
speech control means of the present invention. Other 



structural elements of this receiver 20 J are similar to 
those of the first embodiment, so that further explana- 
tions thereof are omitted. 

[0180] Fig. 24 is a flow chart for explaining the oper- 
5 ation of the receiver 20J according to the tenth embod- 
iment. This receiver operation of the tenth embodiment 
is different from the receiver operation (see Fig. 5) of the 
first embodiment in that, the flow chart of Fig. 24 is made 
different from the flow chart shown in Fig. 5 of the first 
10 embodiment as to such a technical point that a speech 
mode switching process defined at steps S1012 and 
S1017 is interposed between the steps S11 and S12, 
and also interposed between the steps St 5 and S03. 
The process operations at steps other than the above- 
15 described steps are the same as those of the first em- 
bodiment. Processings in the other steps are the same 
as in the first embodiment. 

[0181] Concretely speaking, in the case that com- 
mencement of a CM broadcast is sensed while a broad- 

20 cast program is watched (step S1 002; YES) , the repro- 
ducing management unit 27J selects a highlight scene 
(step S1010), and then enters both image data and 
speech data of the selected highlight scene into the de- 
coder 8a (step S1011). 

25 [0182] Furthermore, the reproducing management 
unit 27J applies the following instruction to the decoder 
8a as the speech mode switching process operation. 
This instruction may switch a speech output channel 
from a main speech channel to a sub-speech channel 

30 (step S1 012). As a consequence, the speech (voice) of 
the highlight scene is outputted from the sub-speech 
channel. 

[01 83] Thereafter, in the case that the end of the CM 
broadcast is sensed (step S1008), the reproducing 

35 management unit 27J executes the switching operation 
from the highlight scene watching mode to the program 
watching mode (step S1016). Subsequently, as the 
speech mode switching process operation, the repro- 
ducing management unit 27J switches the speech out- 

40 put channel from the sub-speech channel to the main 
speech channel (step S1017). 

[0184] In the above-explained receiver example, the 
speech of the broadcast program is watched via the 
main speech channel in the program watching mode. 

45 While the speech of the broadcast program is watched 
via the sub-speech channel in the program watching 
mode, contrary to the above example in such a case 
that this program watching mode is changed into the 
highlight scene watching mode, this sub-speech chan- 

50 nel is switched into the main speech channel. In the case 
that this highlight scene watching mode is changed into 
the program watching mode, the main speech channel 
is switched into the sub-speech channel. 
[01 85] In accordance with the receiver 20 J of the tenth 

55 embodiment when the highlight scene is reproduced, 
both the image of this highlight scene and the sub- 
speech (sub-voice) of this highlight scene are provided 
to the audience. As a result, in particular, when a foreign 
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movie is played, the audience watches the Japanese 
dubbed version of this foreign movie during the main 
broadcasting program, whereas the audience may 
watch by the hero's lines in the original language ver- 
sion, in the highlight scene by utilizing the CM broad- 
casting time. Furthermore, while the audience watches 
the main broadcasting program in the original language, 
the audience may watch the Japanese conversion ver- 
sion of the highlight scene during the CM broadcasting 
time. As a result, the audience may confirm such a 
scene which could not be understood in the original lan- 
guage, which may be effectively utilized in the foreign 
language study using the foreign movies. 

[ELEVENTH EMBODIMENT] 

[01 86] Next, a description is made of an eleventh em- 
bodiment according to the present invention. A hard- 
ware construction of a receiver according to the elev- 
enth embodiment is similar to those of the above-ex- 
plained first embodiment. Fig. 25 is a functional block 
for explaining a receiver 20K according to the eleventh 
embodiment. This receiver 20K owns such a structural 
difference from that of the receiver 20 (see Fig. 2) ac- 
cording to the first embodiment, that a segmental high- 
light scene forming unit 35 (will be referred to as a "form- 
ing unit 35" hereinafter) is employed between the ana- 
lyzing unit 22 and the highlight index storage unit 25. 
[0187] The forming unit 35 is such a function realized 
by executing a computer program by the CPU2. The 
forming unit 35 cuts and sorts highlight scenes detected 
by the analyzing unit 22 into constant lengths thereof. 
In other words, end time instants of the highlight scenes 
detected by the analyzing unit 22 are changed in such 
a manner that the lengths of these highlight scenes be- 
come constant, and addresses corresponding to the 
changed end time instants are acquired as end address- 
es. Then, this forming unit 35 stores such a highlight 
index related to the highlight scenes whose lengths are 
cut and sorted into the highlight index storage unit 25. 
[0188] As a constant length, for example, a single CM 
program is normally formed by a time duration of 1 5 sec- 
onds, or multiplication values thereof (15 seconds, 30 
seconds, 1 minute). A single CM broadcasting time 
range Is constituted by combining a plurality of CM pro- 
grams, and therefore, may have a length of either 1 
minute or 2 minutes. To this end, the forming unit 35 cuts 
and sorts the highlight scenes in the unit of 1 5 seconds. 
Otherwise, since there are many cases that a one-spot 
CM program is broadcasted in the unit of 1 minute, the 
forming unit 35 forms the highlight scenes in the seg- 
ment of 1 minute. 

[01 89] As a consequence, the highlight scenes whose 
lengths are made coincident with the length of the CM 
program can be reproduced while one CM broadcasting 
program is broadcasted which is made coincident with 
either a length of a single CM program or a length of 
plural CM programs, which are broadcasted within one 



* CM broadcasting time range. As a result, a time instant 
when the CM broadcast is ended can be made coinci- 
dent with another time instant when the reproduction of 
the highlight scene is ended. 

5 [01 90] In accordance with the receiver of the eleventh 
embodiment, since a length of a single CM program is 
essentially determined by a preselected value, the CM 
program is formed coincident with the length of the high- 
light scene CM, so that the highlight scene may be re- 

10 produced only during the CM broadcasting time. In other 
words, since the forming unit 35 forms the length of the 
highlight scene in the unit of 1 minute, in such a case 
that the length of the CM broadcasting time range is in- 
creased or decreased in the unit of 1 minute, the high- 

*5 light scene can be just inserted into this CM broadcast- 
ing time range. As a consequence, the audience can 
completely watch the highlight scene instead of the CM 
program. 

20 [TWELFTH EMBODIMENT] 

[0191] Next, a description will now be made of a 
twelfth embodiment of the present invention. A con- 
struction of a receiver according to the twelfth embodi- 
es ment is substantially the same as that of the first em- 
bodiment (see Fig. 1). Fig. 26 is a functional block of a 
receiver 20L according to the twelfth embodiment. 
[01 92] It should be understood that since the receiver 
20L is similar to the receiver 20 of the first embodiment 
30 except for the below-mentioned technical aspect, com- 
mon technical aspects thereof are omitted. 

(12-1 ): A highlight scene classifying unit 36 (will be 
referred to as "classifying unit 36" hereinafter) is 

35 provided between the analyzing unit 22 and a high- 
light index storage unit 25L. 
(12-2) : The input device 37 is provided outside the 
receiver 20L, and also both a user taste registering 
unit 38 and a user taste database 39 are provided 

40 inside the receiver 20L. 

[0193] The classifying unit 36 corresponds to such a 
function realized by executing a computer program by 
the CPU 2. The classifying unit 36 classifies a highlight 
45 scene detected by the analyzing unit 22 into any one of 
the plurality of genres. A genre indicates an attribute of 
a highlight scene, for instance, this attribute represents 
a nature scene, an action scene, a love scene, and the 
like. 

so [0194] Similar to the analyzing unit 22, the classifying 
unit 36 may classify a highlight scene in accordance with 
a previously saved classification condition, by using a 
speech recognition of this high light scene, an image rec- 
ognition thereof, and a combination of these speech/im- 

55 age recognitions. The classification condition may be 
defined in accordance with a screen element contained 
in a scene, and a trend (directivity) of a speech. 
[0195] For example, when the classified genre is a 
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natural scene, since there is a small number of screen 
elements constituted by straight lines, in such a case 
that the straight line components of the screen elements 
of the highlight scene are smaller than or equal to a 
preselected value, the classifying unit 36 judges the rel- 
evant highlight scene as the natural scene, and then 
classifies this highlight scene into such a genre corre- 
sponding to the natural scene. 

[0196] Also, when the classified genre is an action 
scene, the following trend may exist. That is, an object 
greatly moves around, and BGM and effective sounds 
become active and strong. As a consequence, in such 
a case that screen elements and sounds of a highlight 
scene are made coincident with the above-explained 
trend, the classifying unit 36 judges this highlight scene 
as the action scene. 

[0197] Furthermore, generally speaking, a love scene 
is constituted by two persons. There is such a trend that 
voices of these persons are low, and BGM such as a 
ballad is used. As a result, when screen elements of a 
highlight scene is made coincident with this trend, the 
classifying unit 36 judges this highlight scene as the love 
scene. 

[01 98] It should be noted that the present invention is 
not limited to the above-explained example, but may be 
applied to the following case. That is, when the classifi- 
cation condition is determined in accordance with a 
trend (directivity) responding to an attribute of a specific 
genre, a highlight scene may be furthermore classified 
into a plurality of genres. 

[01 99] For instance, while voice of a specific actor and 
a talent are sampled, if a highlight scene contains such 
voice coincident with the sampled voice, then only such 
a scene that either a specific actor or a talent appears 
may be collected. 

[0200] Then, the classifying unit 36 allocates a numer- 
al value indicative of a genre to a highlight scene in ac- 
cordance with a classification result of this highlight 
scene, and stores this numeral value into the highlight 
index storage unit 25L as one of the elements of high- 
light indexes. 

[0201] Fig. 27 is an explanatory diagram for explain- 
ing a data structure of a highlight index storage unit 25 L 
employed in the receiver of the twelfth embodiment. As 
shown In Fig. 27, this highlight index storage unit25L 
saves thereinto the numeral values (in this example, any 
one of 1 to 10) indicative of the genres of the highlight 
scenes in addition to the starting address, the starting 
time instant, the end address, the end time instant, and 
the length of the highlight scene (see Fig. 3) , which are 
explained in connection with the first embodiment. 
[0202] The input device 37 may be arranged by the 
pointing device such as the keyboard 1 6 and the mouse 
17, a remote controller, or a microphone for processing 
a speech recognition of an audience and a speech rec- 
ognizing apparatus. The input device 37 may be used 
so as to register own tastes of the audiences (users) . 
Concretely speaking, an audience inputs a numeral val- 



38 

ue indicative of the own degree of taste with respect to 
each of previously-prepared genres by employing the 
input device 37. 

[0203] The user taste registering unit 38 corresponds 
s to such a function realized by executing a computer pro- 
gram by the CPU 2. When the degree of taste is entered 
from the input device 37, the user taste registering unit 
38 registers this inputted degree of taste into the user 
taste database 39. 
10 [0204] Fig. 28 is an explanatory diagram for explain- 
ing a data structure of the user taste database 39. As 
indicated in Fig. 28, the user taste database 39 owns 
such data items as to genres of highlight scenes, and 
also the degrees of taste of audiences corresponding to 
15 these genres. In this database, the larger the numeral 
value the degree of taste, the higher the taste charac- 
teristic. 

[0205] It should be noted that in this example, only the 
table with respect to one audience is indicated. Alterna- 
te lively, while plural sets of such tables shown in Fig. 28 
are provided, the degrees of taste of plural audiences 
may be registered into these tables. 
[0206] A reproducing management unit 27L manages 
reproducing operations of the highlight scenes recorded 
25 on the buffer disk 21 based upon the CM index, the high- 
light index, and also the content saved in the user taste 
database 39. 

[0207] Operations of the receiver 20L according to the 
twelfth embodiment is substantially the same as those 
30 of the receiver according to the first embodiment, shown 
in Fig. 5. It should also be noted that the operations of 
a highlight selection process operation defined in a step 
S10 is different from that of the first embodiment. That 
is, in the twelfth embodiment, the below-mentioned op- 
35 eration is carried out at the step S10. 

[0208] The reproducing management unit 27L se- 
quentially selects and reproduces such highlight scenes 
which may agree to the taste of the audience from a plu- 
rality of highlight scenes as a highlight scene to be re- 
40 produced while a CM program is broadcasted. 

[0209] In other words, the reproducing management 
unit 27L recognizes the degrees of taste with respect to 
the respective genres of the audiences with reference 
to the user taste database 39. Subsequently, the repre- 
ss duclng management unit 27L sequentially selects and 
reproduces such highlight scenes of genres in which the 
degrees of taste of the users are high with reference to 
the high light index storage unit 25L. As a result, the high- 
light scenes in which the degree of taste of the user is 
50 high are reproduced with top priority among a plurality 
of highlight scenes. 

[021 0] As a consequence, the audience of the broad- 
cast program can watch the highlight scenes in the CM 
broadcasting time range in the order of the own desira- 
55 ble taste. 

[0211] In accordance with the receiver of the twelfth 
embodiment, when the degrees of taste of the audienc- 
es are previously registered, the highlight scenes are 
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reproduced in the order of the degrees of taste thereof. 
In other words, in accordance with the twelfth embodi- 
ment the highlight scenes can be provided with the au- 
diences in response to the tastes which are defined 
based on the attributes (sex, age, character, etc) of the 
audience. Therefore, the audiences can have the satis- 
factory feelings made by watching the highlight scenes 
over a wide range. 

[THIRTEENTH EMBODIMENT) 

[0212] Next, a description will now be made of a thir- 
teenth embodiment of the present invention . A construc- 
tion of a hardware according to the thirteenth embodi- 
ment is substantially the same as that of the first em- 
bodiment (see Fig. 1). Fig. 29 is a functional block of a 
receiver 20M according to the thirteenth embodiment. 
[0213] It should be understood that since the receiver 
20M is similar to the receiver 20 of the first embodiment 
except for the below-mentioned technical aspect, com- 
mon technical aspects thereof are omitted. 

(1 3-1 ): No switch 28 is employed. A decoder 8b into 
which only broadcast data derived from the tuner 
18 is entered is connected in parallel to another de- 
coder 8c into which only broadcast data derived 
from the buffer disk 21 is entered. 
(13-2): A plural screen display unit 41 (equal to dis- 
play control unit) is employed which is connected to 
the respective decoders 8b and 8c, and further- 
more, to the display apparatus 15. 
(13-3) : A reproducing management unit 27M con- 
trols operation of the plural screen display unit 41 . 

[021 4] Fig. 30 is a flow chart for indicating operations 
of the receiver 20M according to the thirteenth embod- 
iment. The flow chart of Fig. 30 owns such a different 
step, instead of the process operations defined at the 
steps S11 and S15 in the flow chart of the first embodi- 
ment (shown in Fig. 5), a plural screen display process 
operation (step S1312) is executed instead of the step 
S11, and also a single screen display process (step 
S1 31 7) is executed instead of the step S1 5. The process 
operations other than those of the above-explained 
steps are the same as those of the first embodiment. 
[0215] Concretely speaking, since the receiver 20 M 
of the thirteenth embodiment employs the arrangement 
of Fig. 29, the broadcast data supplied from the tuner 
18 is always inputted into the.decoder 8b while the au- 
dience watches the broadcast program. When the com- 
mencement of the CM broadcast is sensed (step 
S1302), the reproducing management unit 27M in- 
structs the plural screen display unit 41 in such a manner 
that both the broadcasting screen of the program and 
the screen of the highlight scene are displayed at the 
same time on the monitor of the display apparatus 15 
(stepS131-1). 

[0216] On the other hand, when the end of the CM 



• broadcast is sensed (step S1308), the reproducing 
management unit 27M instructs the plural screen dis- 
play unit 41 in such a manner that only the broadcast 
screen of the program is displayed on the monitor of the 

5 display apparatus 15 (step S1315). In this way, the au- 
dience is able to watch the highlight scene on a plural 
screen display during the CM broadcast time range, and 
when the CM broadcast time range ends, to watch the 
subsequent program on a single screen display 

10 [0217] Fig. 31 illustratively shows an example of a 
screen display image of the receiver according to the 
thirteenth embodiment. In Fig. 31, 4 pattern examples 
"A" to "D" are displayed as a pattern example of a plural 
screen display in a CM broadcasting time range. It 

15 should be noted that if the plural screen display is real- 
ized, then other pattern examples than the above-ex- 
plained patterns "A" to "D" may be employed. 
[0218] The pattern example "A" corresponds to such 
a display pattern that a screen of a highlight scene (high- 

20 light screen) is displayed in a full-sized screen, and a 
screen received in r^al time (received broadcast screen) 
is overlapped on this highlight screen located at a lower 
right corner in a small screen display. 
[0219] The pattern example "B° and the pattern ex- 

25 ample "C" correspond to such a pattern example that 
the highlight screen is not overlapped with the received 
broadcast screen. The pattern example "B" is featured 
by that the size of the highlight screen is larger than the 
size of the received broadcast screen. The pattern ex- 

30 ample "C" is featured by that the size of the highlight 
screen is equal to the size of the received broadcast 
screen. 

[0220] In accordance with the receiver of the thir- 
teenth embodiment, both the highlight screen and the 

35 received broadcast screen of the CM broadcast are si- 
multaneously displayed on the display apparatus 15 
while the CM broadcast is carried out. As a result, the 
audience can watch the highlight scene at the same time 
as when the audience watches the received broadcast 

40 screen of the CM broadcast. As a consequence, this re- 
ceiver can meet such a requirement of the audience, 
that although the audience wishes to watch only a pop- 
ular CM program and a CM program in which a favorite 
talent appears, the audience does not wish to watch oth- 

45 er CM programs than the above-explained CM pro- 
grams. 

[0221] It should also be noted that the highlight scene 
reproduced in the thirteenth embodiment may be ac- 
quired by way of the method of the second or the third 
50 embodiment. 

[FOURTEENTH EMBODIMENT] 

[0222] Next, a description will now be made of a four- 
55 teenth embodiment of the present invention. A construc- 
tion of a hardware according to the fourteenth embodi- 
ment is substantially the same as that of the first em- 
bodiment (see Fig. 1). A functional block of a receiver 
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20M according to this fourteenth embodiment is similar 
to that of the thirteenth embodiment (see Fig. 29). 
[0223] It should be noted that operations of the receiv- 
er of the fourteenth embodiment are different from those 
of the thirteenth embodiment. In other words, in the four- 
teenth embodiment, in such a case that both a highlight 
scene and a CM broadcast are displayed in a plural 
screen display mode, when the CM broadcast is ended, 
the plural screen display mode (display mode) is 
changed. Thereafter, when the reproduction of the high- 
light scene is ended, the display mode is advanced to 
the single screen display of the received broadcast 
screen. 

[0224] Fig. 32 is a flow chart for describing operations 
of the receiver 20M according to the fourteenth embod- 
iment. Referring now to Fig. 32, a major operation of this 
receiver 20M will be explained. 

[0225] At a step S1402, the CM start sensing unit 23 
analyzes the broadcast data received from the tuner 1 8 
so as to judge whether or not the CM broadcast is com- 
menced. At this time, when the CM broadcast is not yet 
commenced (step S1402; NO), a highlight analyzing 
process operation (step S1403: see Fig. 6) is carried 
out, and thereafter, the audience watches the broadcast 
program (step S1404). It should also be noted that the 
processing order of the steps S1 403 and S1 404 may be 
reversed. Thereafter, when the audience continues to 
watch the broadcast program (step S1405; NO), the 
process is returned to the step S1401 . 
[0226] On the other hand, in the case that the CM start 
sensing unit 23 senses the start of the CM broadcast 
(step S1402; YES), a CM start index storage process 
operation is executed (step S1406: see Fig. 7(A)). 
Thereafter, the reproducing operation of the highlight 
scene is carried out until the end of the CM broadcast 
is sensed in a CM end sensing process operation 
(S1407). 

[0227] That is to say, a highlight selection process op- 
eration is executed if required (step S1410: see Fig. 8). 
A first plural screen display process operation (step 

51411 ) is carried out which is similar to the plural screen 
display process operation (step S1 31 1 ) of the thirteenth 
embodiment. As a result, the audience can watch the 
highlight scene in the plural screen display mode (step 

51412) . 

[0228] Thereafter, when the CM end sensing process 
(step S1407) is carried out, P the reproducing operation 
of the highlight scene (step S1408; NO) and also the 
CM broadcast is accomplished (step S1409; YES), then 
a CM end index storage process operation (step S1 41 6: 
see Fig. 7(B)) is executed. Thereafter, the single screen 
display process operation similarto that of the thirteenth 
embodiment is carried out (step S1 41 7), and the present 
watching mode is advanced to the program watching 
mode (step S1404). 

[0229] On the other hand, when the CM end sensing 
process operation (step S1407) is executed, in such a 
case that the reproducing operation of the highlight 



scene is not yet ended (in case of highlight watching 
mode) (step S1408; YES), a check is made as to wheth- 
er or not the CM broadcast is ended (step S1414). 
[0230] At this time, when the CM broadcast is not yet 

5 ended (step S1414; NO), the process is advanced to a 
further step S1412. At this step S1412, the reproducing 
operation/plural screen display operation of the highlight 
scene are continued. To the contrary, in the case that 
the CM broadcast is ended while the audience watches 

10 the highlight scene (step S1414; YES), a second plural 
screen display process operation (step S1415) is car- 
ried out, and the display pattern of the plural screen dis- 
play is changed. Thereafter, the process operation is ad- 
vanced to a step S1412. 

15 [0231] Fig. 33 is an explanatory diagram for explain- 
ing a screen display example obtained in connection 
with the operations of the receiver of the fourteenth em- 
bodiment. In Fig. 33, there are three pattern examples 
A1 , B1 , and C1 . As indicated in Fig. 33, before the CM 

20 broadcast is commenced, the received broadcast 
screen is displayed in the single screen display mode. 
Thereafter, when the CM broadcast is commenced, the 
first plural screen display operation is carried out. In the 
first plural screen display operation, both the highlight 

25 screen and the received broadcast screen of the CM 
broadcast are displayed on the monitor at the same 
time. On the respective screens, sizes of screens and 
ordering of display positions are previously given. 
[0232] In other words, both the pattern examples A1 

30 and B1 are such pattern examples that the orders of the 
highlight screens are high in view of screen sizes, and 
the sizes of the highlight screens are largerthan the siz- 
es of the received broadcast screens. To the contrary, 
the pattern example C1 corresponds to such a pattern 

35 example that the order of the received broadcast screen 
of the CM broadcast is high in view of the display posi- 
tion, and the received broadcast screen is displayed in 
front of the highlight screen. 

[0233] In such a case that the CM broadcast is ac- 
40 complished while the audience watches the highlight 
scene, the display mode is changed into the second plu- 
ral screen display mode under control of the plural 
screen display unit 41 by the reproducing management 
unit 27M. This display mode change is carried out by 
45 reversing, for example, the order in the first plural screen 
display operation. 

[0234] Pattern examples A'1 , B'1 , and C'1 shown in 
Fig. 33 and corresponding to the example of the second 
plural screen display are such pattern example obtained 

so by reversing the ordering of the first plural screen dis- 
play, in which the highlight screen is substituted by the 
received broadcast screen of the program. Thereafter, 
at a time instant when the audience ends watching the 
highlight screen, the present screen display operation 

ss is returned to the original single screen display operation 
of the received broadcast screen. 
[0235] In accordance with the receiver of the four- 
teenth embodiment, even when the CM broadcast is 
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ended, since the plural screen display operation is exe- 
cuted, the audience can watch the highlight scene and 
the broadcast program at the same time even after the 
CM broadcast is ended, and therefore, it is possible to 
prevent such watching of the highlight scene half way. 
[0236] Also, the ordering are previously given to both 
the sizes and the display positions as to the highlight 
screen and the received broadcast screen in the plural 
screen display operation. While the CM program is 
broadcasted, the order of the highlight screen is set to 
the high order, whereas the order of the received broad- 
cast screen is set to the high order after the CM broad- 
cast is ended. 

[0237] As a consequence, while one audience who 
wishes to watch the broadcast program in real time is 
treated with a top priority, a requirement of another au- 
dience who wishes to completely watch a highlight 
scene can be met In the receiver of this fourteenth em- 
bodiment. It should also be noted that the ordering op- 
eration as to the highlight screen and the received 
broadcast screen may be made opposite to that of the 
above-explained example by manipulation from the au- 
dience. 

[FIFTEENTH EMBODIMENT] 

[0238] Next, a description will now be made of a fif- 
teenth embodiment of the present invention. A construc- 
tion of a receiver according to the fifteenth embodiment 
may be realized by employing a similar construction of 
the first embodiment (see Fig. 1). Fig. 34 is a functional 
block diagram of a receiver 20N according to this fif- 
teenth embodiment. The receiver 20N is arranged by 
adding an input device 42, an index screen display unit 
44, a highlight scene instructing unit 43, and a switch 45 
to the structural elements (see Fig. 2) of the first embod- 
iment. 

[0239] The index screen display unit 44 is such a func- 
tion realized by executing a computer program by the 
CPU 2. The index screen display unit 44 reads a starting 
address of each highlight scene stored in the highlight 
index storage unit 25, reads a first scene of a highlight 
scene stored at this starting address from the buffer disk 
21, and then, forms a still image indicative of the first 
scene of the highlight scene. 

[0240] Then, the index screen display unit 44 saves 
the formed still image as an index, and outputs this 
saved index to the display apparatus 15. At this time, in 
such a case that the switch 45 is brought into such a 
switching state that the index screen display unit 44 is 
connected to the display apparatus 15, a still image of 
a single highlight scene, or still images of plural highlight 
scenes are displayed as an index screen (see Fig. 36) 
on the monitor of the display apparatus 15. 
[0241] The input device 42 may be arranged by the 
pointing device such as the keyboard 1 6 and the mouse 
1 7, a remote controller, or a microphone for processing 
a speech recognition of an audience and a speech rec- 



44 

ognizing apparatus. The input device 42 may be used 
so as to select a desirable highlight scene, while the au- 
dience refers to the index screen. 
[0242] The highlight scene instructing unit 43 is such 

5 a function realized by executing a computer program by 
the CPU 2. The highlight scene instructing unit 43 is in- 
itiated in such a case that the CM start sensing unit 23 
senses the commencement of the CM broadcast. Then, 
the highlight scene instructing unit 43 switches the 

io switch 45 to the switch side of the index screen display 
unit 44 so as to display an index screen on the display 
apparatus 15. 

[0243] Thereafter, when a designation of a highlight 
scene is entered from the input device 42, the highlight 

15 scene instructing unit 43 controls the reproducing man- 
agement unit 27N in order that this highlight scene is 
displayed on the display apparatus 15, and also switch- 
es the switch 45 to the side of the decoder 8a. 
[0244] The reproducing management unit 27N re- 

20 ceives the reproduction instruction of the highlight scene 
designated by thQjnput device 42 from the highlight 
scene instruction unit 43. As a result, the reproducing 
management unit 27N inputs such broadcast data cor- 
responding to the designated highlight scene into the 

25 decoder 8a in accordance with this reproduction instruc- 
tion by way of the manner as explained in the first em- 
bodiment. As a consequence, the designated highlight 
scene is displayed on the monitor of the display appa- 
ratus 15. 

30 [0245] The switch 45 owns a structure substantially 
equal to that of the switch 28. The highlight scene in- 
structing unit 43 causes the switch 45 to be switched to 
any one switch side between the decoder 8a and the 
index screen display unit 44. 

35 [0246] Fig. 35 is a flow chart for describing process 
operations of the receiver 20N according to the 15th em- 
bodiment in the case that the receiver 20N receives 
broadcast data. Referring now to this flow chart of Fig. 
35, a major operation executed in this receiver 20N will 

40 now be described. 

[0247] At a step S1 502 of Fig. 35, when it is so judged 
that a CM broadcast is not yet commenced, a highlight 
analyzing process operation (step S1503: see Fig. 6) is 
executed, and thereafter, an audience watches a broad- 

45 cast program (step S1 504). It should be understood that 
the process sequence of the steps S1503 and S1504 
may be reversed, as compared with the above-ex- 
plained process sequence. Next, when the audience 
continues to watch the broadcast program (step S1505; 

so NO), this process operation is returned to the step 
S1501. 

[0248] On the other hand, in such a case that a com- 
mencement of a CM broadcast is sensed (step S1502; 
YES), a CM start index storage process operation is car- 
55 ried out (step S1 506; see Fig. 7(A)). Thereafter, an index 
screen display process operation is executed (step 
S1 507). That is, an index screen is displayed on the dis- 
play apparatus 1 5 by both the highlight scene instructing 
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unit 43 and the index screen display unit 44. 
[0249] When the index screen is displayed, this index 
screen is kept displayed until the audience (user) des- 
ignates a highlight scene by manipulating the input de- 
vice 42, or the CM broadcasting time range is ended 
(namely, loop process defined by steps S1507, S1508, 
and S516). 

[0250] While the index screen is displayed, in the case 
that the audience designates (selects) the highlight 
scene (step S1508; YES), the designated highlight 
scene is reproduced by the reproducing management 
unit 27N until the end of the CM broadcast is sensed at 
the step S1509 (namely, loop process defined by steps 
S1509 to S1515). It should be noted that in Fig. 35, both 
the end sensing process operation (step S07 of Fig. 5) 
and the condition judging operation (step S08 of Fig. 5) 
are integrated with each other as steps S1509 and 
S1516. 

[0251] In the loop process operation defined by the 
steps S1509 to S1515, when the highlight scene is not 
yet selected (step S1510; NO) , a highlight selecting 
process operation is executed, and then, the designated 
highlight scene is selected (step S1511 : see Fig. 8). 
[0252] Thereafter, the switch 45 is switched from the 
broadcast data derived from the tuner 1 8 for the decoder 
8a into the data derived from the buffer disk 21 (step 
1 51 2), and the screen display mode is returned from the 
index image display mode to the normal screen display 
mode in order that the audience watches the highlight 
scene (steps S1513 and S1514). 
[0253] Thereafter, in the case that the end of the CM 
broadcast is sensed (step S1 509; YES), a CM end index 
storage process operation (step 1517: see Fig. 7(B)) is 
carried out. Next, in the case that the index screen is 
displayed on the display apparatus 15, the index screen 
is switched to the normal screen (step S1 51 8), and the 
switch 45 is switched from the broadcast data derived 
from the buffer disk 21 for the decoder 8a to the data 
derived from the tuner 18 (step S1519), and then, the 
present watching mode is advanced to the program 
watching mode (steps S1503 and S1504). 
[0254] Fig. 36 illustratively shows a screen display im- 
age of the monitor according to the 15th embodiment. 
As indicated in Fig. 36, just before the CM broadcast is 
commenced, the normal screen is displayed on the 
monitor. When the commencement of the CM broadcast 
is sensed, the normal screen is switched into an index 
screen. The index screen displays as an index, a still 
image of a head screen of such a highlight scene which 
is formed in the index screen display unit 44 (corre- 
sponding to index providing unit), and is selectable. The 
indexes are displayed on subdivided areas, for instance, 
which are produced by equally dividing the display area 
of the monitor. 

[0255] While the audience refers to the indexes (still 
images) displayed on the index screen, if a desirable 
highlight scene is present, then the audience designates 
(selects) this desirable highlight scene by operating the 



' input device 42. As a consequence, the index screen is 
switched to the normal screen, and thus, the selected 
highlight scene is displayed. In Fig. 36, symbols "HA" 
and "HB" correspond to the selected highlight scene. 

5 [0256] To the contrary, as indicated in Fig. 36, an in- 
dex of a received broadcast program which is selected 
when the audience wants to watch the CM program, or 
when the audience does not want to watch the highlight 
scene may be contained in the index screen. 

10 [0257] As the index of the received broadcast, for in- 
stance, either a still image of a broadcast program ap- 
peared just before a CM broadcast is started, or another 
still image of the broadcast program appeared just after 
the CM broadcast is commenced may be formed by the 

*5 index screen display unit 44 to be displayed. Alterna- 
tively, such a button used to select the received broad- 
cast may be displayed as an index of this received 
broadcast. 

[0258] In the case thai the index of the received 
20 broadcast is selected, the switch 28 is switched to the 
side of the tuner 1fi, and also the switch 45 is switched 
to the side of the decoder 8a. As a result, the index 
screen is switched to the normal screen, and the CM 
broadcast is displayed on the monitor. In other words, 
25 the CM program may be provided with the audience in 
real time. Thereafter, when the CM broadcast is ended, 
the broadcast program may be continuously provided 
with the audience. 

[0259] In accordance with the 15th embodiment, 

30 while the index screen of the highlight scene is dis- 
played, when the audience selects a desirable highlight 
scene, this selected desirable highlight scene is repro- 
duced. As a result, since the audience can watch the 
desirable highlight scene, the CM broadcasting time 

35 range can be more effectively utilized, as compared with 
that of other embodiments. Also, in such a case that 
such a desirable highlight scene is not contained in the 
index screen, the audience may watch the CM broad- 
cast by selection on watching of the received broadcast. 

40 [0260] Itshouldbenotedthatinthe 15th embodiment, 
the still image is employed as the index of the highlight 
scene. This index may be realized by such a text indic- 
ative of a content of the highlight scene. Also, as indi- 
cated in Fig. 36, the index screen is not displayed on the 

45 area obtained by equally subdividing the index, but may 
be displayed in a list form. 

[0261] In the flow chart shown in Fig. 35, in such a 
case that the length of the selected highlight scene is 
shorter than the CM broadcasting time range, after the 

50 reproducing operation of the selected highlight scene 
has been completed, the selected highlight scene is re- 
produced by the reproducing management unit 27 until 
the CM broadcasting time range is ended. To the con- 
trary, in the case that the reproducing operation of the 

55 selected highlight scene is accomplished before the CM 
broadcasting time range is ended, the index screen may 
be displayed again. 
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[16TH EMBODIMENT] 

[0262] Next, a description will now be made of a 1 6th 
embodiment of the present invention. A construction of 
a receiver according to the 1 6th embodiment is substan- 5 
tially same as that of the sixth embodiment (see Fig. 1 ). 
It should be understood that in the receiver of the 16th 
embodiment, a digest of the broadcast program which 
has been so far watched by an audience is reproduced 
after one broadcast program has been ended until an- 
otherbroadcast program subsequent tothe above-men- 
tioned broadcast program is commenced. 
[0263] A recognition of a program end and a program 
start is carried out in accordance with the below-men- 
tioned manner. That is, for instance, there is such a serv- 
ice that program information (broadcast program: "elec- 
tronic program list") is provided via the Internet and the 
like. The data related to a starting time instant and also 
an end time instant of a program are acquired by utilizing 
this service. Then, both the program end time instant 
" and the program starting time instant can be recognized 
by using these data. An electronic program list is re- 
ferred to as an n EPG (Electronic Program Guide)", and 
is contained in broadcast electromagnetic waves in the 
BS digital broadcasting system. Alternatively, an audi- 
ence may manually input a broadcast program (program 
starting time instant and program end time instant) into 
the receiver. 

[0264] In such a case that a broadcast program is ar- 
ranged by entering combined CM programs after this 
broadcast program is accomplished, if total time of the 
CM programs is counted from a starting time instant of 
this broadcast program, since a CM insertion ratio with 
respect to the broadcast program is determined. Ac- 
cordingly; a time duration of the CM programs which are 
inserted into the broadcast program after this program 
is ended until the next program is commenced can be 
calculated backward. 

[0265] The digest may be formed by coupling the pro- 
gram digests which are explained in the sixth embodi- 

- ment. In such a case that the length of the digest is de- 
sired to be adjusted to be equal to the time duration up 
to the next program, for example, as previously ex- 

- plained in the eighth embodiment, the following length 
adjusting method may be employed. That is, while the 
importance degrees are allocated to the respective pro- 
gram digests, the program digests having the higher im- 
portance degrees are sequentially selected, and the se- 
lected program digests are coupled to each other. As a 
result, the length of the coupled program digests is ad- 
justed in such a manner that the length of the digest is 
made equal to the length of the CM broadcasting time 
range between the two continuous broadcast programs. 
[0266] Fig. 37 is a diagram for indicating a relationship 
between a write address and a read address to a buffer 
disk in the receiver of the 16th embodiment. In Fig. 37, 
during from when a program "A" is accomplished until a 
program "B" is commenced, a digest of the program "A" 



which has been so far watched is reproduced. At a time 
instant when the commencement of the program "B" is 
sensed, the present watching mode is returned to the 
program watching mode. 

[0267] In accordance with the 16th embodiment, in 
the CM broadcasting time range between the two con- 
tinuous programs, the digest of the broadcast program, 
which has been broadcasted just before this CM broad- 
casting time range, is reproduced. As a result, the audi- 
ence can watch the digest of such a broadcast program 
which has been watched after one broadcast program 
is ended and until the next broadcast program is com- 
menced. 

[0268] As a consequence, the audience can take an- 
other look as to feelings of the program. For example, 
when the audience is impressed with the broadcast pro- 
gram, this audience can be deeply impressed with this 
broadcast program by watching the digest of this pro- 
gram. Otherwise, by watching the digest of the program, 
the audience can furthermore have a deep understand- 
ing of the story of tfje program, and thus, this audience 
may have other feelings different from the feelings with 
respect to this broadcast. 

[0269] It should be understood that the CM end sens- 
ing unit 24 for sensing the end of the CM broadcast is 
employed in the above-explained first to 16th embodi- 
ments. Instead of this CM end sensing unit 24, a time 
measuring unit (timer) may be employed. This time 
measuring unit is operated as follows. When a prede- 
termined time duration has passed after a commence- 
ment of a CM broadcast is sensed, the present watching 
mode is automatically transferred to the program watch- 
ing mode. When such a time measuring unit is em- 
ployed, the arrangement of the receiver can be made 
simpler. Moreover, if the CM broadcasting time range is 
previously grasped, then the CM programs can be com- 
pletely cut. 

[0270] It should also be noted that the arrangements 
of the receivers as explained in the fkst to 1 6th embod- 
iments may be properly combined with each other. 
[0271] In the broadcast receiver, the broadcast con- 
trol method, and the recording medium for recording 
thereon the computer program, according to the present 
invention, the audience need not perform the zapping 
operation. Therefore, ft is possible to avoid such a prob- 
lem that the audience may loose his interests as to the 
broadcast program even in the CM broadcasting time 
range contained in this broadcast program. 
[0272] This invention being thus described, it will be 
obvious that same may be varied in various ways. Such 
variations are not to be regarded as departure from the 
scope of the invention, and all such modifications would 
be obvious for one skilled in the art intended to be in- 
cluded within the scope of the following claims. 
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Claims 

1. A broadcast receiver comprising: 

a highlight scene detecting unit for detecting a 
highlight scene of a broadcast program; 
a store unit for storing at least said detected 
highlight scene of said program into a storage 
device; 

a CM detecting unit for detecting a CM (com- 
mercial message) broadcast program; and 
a reproducing control unit for reproducing said 
highlight scene stored in said storage device 
while said CM program is broadcast 

2. A broadcast receiver as claimed in claim 1 wherein: 

said CM detecting unit includes: 

a CM start detecting unit for detecting a com- 
mencement of said CM broadcast; and wherein 
when said CM broadcast is commenced, the re- 
production of said highlight scene is com- 
menced. 

3. A broadcast receiver as claimed in claim 1 or claim 
2 wherein: 

the reproduced highlight scene is shown in- 
stead of said CM broadcast program. 

4. A broadcast receiver as claimed in claim 1 or claim 
2 wherein: 

the reproduced highlight scene is shown in 
conjunction with said CM broadcast program. 

5. A broadcast receiver as claimed in any one of 
claims 1 to 4 wherein: 

said highlight scene detecting unit detects the 
highlight scene based upon an index indicative of 
the highlight scene contained in broadcast data of 
said broadcast program. 

6. A broadcast receiver as claimed in any one of 
claims 1 to 5 wherein: 

said highlight scene detecting unit detects the 
highlight scene in response to an instruction issued 
from the audience. 

7. A broadcast receiver as claimed in any one of 
claims 1 to 6 wherein: 

said storage device stores thereinto a data por- 
tion of the broadcast data corresponding to a 
predetermined time duration at any time; and 
in such a case that when the CM broadcast is 
ended, the reproduction of the highlight scene 
has not yet been amplished, said reproducing 
control unit reproduces such broadcast data as 
appeared just after said CM broadcast ended 



after the reproduction of said highlight scene 
has been completed. 

8. A broadcast receiver as claimed in claim 7 wherein: 
5 in such a case that when the broadcast data'is 

reproduced, a next CM broadcast is commenced, if 
a time difference between a broadcast time instant 
and a reproduction time instant exceeds broadcast 
time of the next CM broadcast program, said repro- 
10 ducing control unit continues to reproduce said 
broadcast data without executing the reproduction 
of said highlight scene. 

9. A broadcast receiver as claimed in any one of 
15 claims 1 to 8 wherein: 

said reproducing control unit reproduces a 
program digest constructed of a plurality of highlight 
scenes as said highlight scene. 

20 10. A broadcast receiver as claimed in any one of 
claims 1 to 4, cjaims 7 and 6 wherein: 

said storage device stores thereinto a data por- 
tion of the broadcast data corresponding to a 

25 predetermined time duration at any time; and 

when the CM broadcast is commenced, said re- 
producing control unit reproduces as said high- 
light scene, a broadcast data portion which is 
stored in said storage device, and is defined 

30 from a time instant when the CM broadcast is 

started and until a preselected time duration is 
retraced. 

11. A broadcast receiver as claimed in any one of 
35 claims 1 to 4, claims 7 and B wherein: 

said storage device stores thereinto a plurality 
of highlight scenes to which importance de- 
grees are allocated respectively; and 
40 said reproducing control unit reproduces a 

highlight scene at a speed corresponding to an 
importance degree thereof. 

12. A broadcast receiver as claimed in any one of 
45 claims 1 to 6 wherein: 

said reproducing control unit reproduces a still 
image as the highlight scene. 

13. A broadcast receiver as claimed in any preceding 
50 claim wherein: 

said broadcast program contains first speech 
(voice) and second speech (voice); and 
said broadcast receiver is further comprised of: 
55 speech control means for providing any 

one of said first speech and said second 
speech when the broadcast program is provid- 
ed in connection with a broadcast time instant; 
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and also for providing the other speech be- 
tween said first speech and said second 
speech when the highlight scene is repro- 
duced. 

14. A broadcast receiver as claimed in any preceding 
claim wherein: 

said reproducing control unit reproduces such 
a highlight scene having a length which is made co- 
incident with broadcast time of a CM program in- 
serted into the broadcast program. 

15. A broadcast receiver as claimed in any preceding 
claim wherein 

said broadcast receiver is further comprised 

of: 

a highlight scene classifying unit for classifying 
the highlight scenes stored in said storage de- 
vice into plural sorts of classifications; and 
wherein 

said reproducing control unit reads out such a 
highlight scene having a sort corresponding to 
a taste of an audience with having a top priority 
from said storage device to reproduce the read 
highlight scene in such a case that the CM 
broadcast is commenced. 

16. A broadcast receiver as claimed in claim 4, further 
comprising: 

a display control unit for displaying at the 
same time, both an image of broadcast data in re- 
sponse to a broadcast time instant and an image of 
a reproduced highlight scene on a single display 
screen. 

17. A broadcast receiver as claimed in claim 1 6 where- 
in: 

said display control unit changes any one of 
sizes and display positions with respect to said dis- 
play screen as to both a display area for said image 
of the broadcast data and a display area for said 
image of the highlight scene in the case that the CM 
broadcast is ended. 

18. A broadcast receiver as claimed in any one of 
claims 1 to 17 wherein: 



said reproducing control unit reproduces any 
one of the highlight scene and a digest constituted 
of plural highlight scenes of a certain broadcast pro- 
gram during a time period defined after said certain 
5 broadcast program is ended and until a next broad- 
cast program is commenced. 

20. A broadcast control method comprising: 

10 detecting a highlight scene of a broadcast pro- 

gram; 

storing at least said detected highlight scene of 
said program into a storage device; 
detecting a CM (commercial message) broad- 
's cast program; and 

reproducing said highlight scene stored in said 
storage device while said CM program is broad- 
cast. 

20 21. A broadcast control method as claimed in claim 20 
further comprising: 

detecting a commencement of said CM broad- 
cast; and 

25 commencing the reproduction of said highlight 

scene when said CM broadcast is commenced. 

22. A broadcast control method as claimed in claim 20 
or claim 21 further comprising: 

so showing the reproduced highlight scene in- 

stead of said CM broadcast program. 

23. A broadcast control method as claimed in claim 20 
or claim 21 further comprising: 

35 showing the reproduced highlight scene in 

conjunction with said CM broadcast program. 

24. A broadcast control method as claimed in any one 
of claims 20 to 23 further comprising: 

40 detecting the highlight scene based upon an 

index indicative of the highlight scene contained in 
broadcast data of said broadcast program. 

25. A broadcast control method as claimed in any one 
45 of claims 20 to 23 further comprising: 

detecting the highlight scene In response to 
an instruction issued from the audience. 



said storage device stores thereinto any one of 

a single set and plural sets of highlight scenes; 50 

and 

said broadcast receiver is further comprised of: 
an index providing unit for providing an in- 
dex used to select a desirable highlight scene 
when the CM broadcast is commenced. 55 

19. A broadcast receiver as claimed in any preceding 
claim wherein: 



26. A broadcast control method as claimed in claim 22 
further comprising: 

storing a data portion of the broadcast data cor- 
responding to a predetermined time duration at 
any time into said storage device; and 
reproducing such broadcast data as appeared 
just after said CM broadcast ended after the re- 
production of said highlight scene has been 
completed in such a case that when the CM 
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broadcast is ended and the reproduction of the 
highlight scene has not yet been accomplished. 

27. A broadcast control method as claimed in claim 26 
further comprising: 

commencing a next CM broadcast if a time dif- 
ference between a broadcast time instant and 
a reproduction time instant exceeds broadcast 
time of the next CM broadcast program in such 
a case that when the broadcast data is repro- 
duced, and 

continuing the reproduction of said broadcast 
data without executing the reproduction of said 
highlight scene. 

28. A broadcast control method as claimed in any one 
of claims 20 to 27 wherein: 

said highlight scene is a program digest con- 
structed of a plurality of highlight scenes. 

29. A broadcast control method as claimed in any one 
of claims 20 to 22, claims 26 and 27 further com- 
prising: 

storing a data portion of the broadcast data cor- 
responding to a predetermined time duration at 
any time into said storage device; and 
reproducing a broadcast data portion which is 
stored in said storage device, and is defined 
from a time instant when the CM broadcast is 
started and until a preselected time duration is 
retraced when the CM broadcast is com- 
menced, as said highlight scene. 

30. A broadcast control method as claimed in any one 
of claims 20 to 22, claims 26 and 27 further com- 
prising: 

storing a plurality of highlight scenes to which 
importance degrees are allocated respectively 
into said storage device; and 
reproducing a highlight scene at a speed cor- 
responding to an importance degree thereof. 

31. A broadcast control method as claimed in any one 
of claims 20 to 25 furthe r comprising: 

reproducing a still image as the highlight 
scene. 

32. A broadcast control method as claimed in any one 
of claims 20 to 25 wherein: 

said broadcast program contains first speech 
(voice) and second speech (voice); and 
any one of said first speech and said second 
speech is provided when the broadcast pro- 
gram is provided in connection with a broadcast 
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time instant; and atso the other speech be- 
tween said first speech and said second 
speech is provided when the highlight scene is 
reproduced. 

5 

33. A broadcast control method as claimed in any one 
of claims 20 to 25 wherein: 

said highlight scene owns a length which is 
made coincident with broadcast time of a CM pro- 
10 gram inserted into the broadcast program. 

34. A broadcast control method as claimed in any one 
of claims 20 to 25 further comprising: 

15 classifying the highlight scenes stored in said 

storage device into plural sorts of classifica- 
tions; 

reading such a highlight scene having a sort 
corresponding to a taste of an audience with a 
20 top priority from said storage device in such a 

case that tbe CM broadcast is commenced; and 
reproducing the read highlight scene. 

35. A broadcast control method as claimed in claim 23, 
25 further comprising: 

simultaneously displaying both an image of 
broadcast data in response to a broadcast time in- 
stant and an image of a reproduced highlight scene 
on a single display screen. 

30 

36. A broadcast control method as claimed in claim 35 
further comprising: 

changing any one of sizes and display posi- 
tions with respect to said display screen as to both 
35 a display area for said image of the broadcast data 
and a display area for said image of the highlight 
scene in the case that the CM broadcast is ended. 

37. A broadcast control method as slaimed in any one 
40 of claims 20, 22, 24, and 25 further comprising: 

storing any one of a single set and plural sets 
of highlight scenes into said storage device; 
and 

45 providing an index used to select a desirable 

highlight scene with the audience when the CM 
broadcast is commenced. 

38. A broadcast control method as claimed in any one 
50 of claims 20 to 25 further comprising: 

reproducing any one of the highlight scene 
and a digest constituted of plural highlight scenes 
of a certain broadcast program during a time period 
defined after said certain broadcast program is end- 
55 ed and until a next broadcast program is com- 
menced. 

39. A recording medium for recording thereon a pro- 
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gram used to cause a computer to execute: 

a step for detecting a highlight scene of a 
broadcast program; 

a step for storing at least said detected highlight 5 
scene of said program into a storage device; 
a step for detecting a CM (commercial mes- 
sage) broadcast program; and 
a step for reproducing said highlight scene 
stored in said storage device while said CM pro- io 
gram is broadcast. 

40. A computer readable recording medium as claimed 
in claim 39 wherein: 



said CM broadcast detecting step detects a 
commencement of the CM broadcast; and 
said program is further comprised of: 

a step for starting the reproduction of said 
highlight scene when said CM broadcast is 
commenced. 

41 . A computer readable recording medium as claimed 
in claim 39 or claim 40 wherein: 

said program is further comprised of a step for 
showing the reproduced highlight scene instead of 
said CM broadcast program. 

42. A computer readable recording medium as claimed 
in claim 39 or claim 40 wherein: 

said program is further comprised of a step for 
showing the reproduced highlight scene in conjunc- 
tion with said CM broadcast program. 



said CM broadcast is ended after the reproduc- 
tion of said highlight scene is reproduced. 

46. A computer readable recording medium as claimed 
in claim 45 wherein: 

in such a case that when the broadcast data 
is reproduced, a next CM broadcast is commenced, 
if a time difference between a broadcast time instant 
and a reproduction time instant exceeds broadcast 
time of the next CM broadcast program, said pro- 
gram continues to reproduce said broadcast data 
without executing the reproduction of said highlight 
scene. 



20 



25 



43. A computer readable recording medium as claimed 
in any one of claims 39 to 42 wherein: 

in said highlight scene detecting step, the 
highlight scene is detected based upon an index in- 
dicative of the highlight scene contained in broad- 
cast data of said broadcast program. 40 

44. A computer readable recording medium as claimed 
in any one of claims 39 to 42 wherein: 

in said highlight scene detecting step, the 
highlight scene is detected in response to an in- 45 
struction issued from the audience. 50. 

45. A computer readable recording medium as claimed 
in claim 41 wherein: 

so 

said program causes said storage device to 51. 
temporarily store thereinto a data portion of the 
broadcast data corresponding to a predeter- 
mined time duration; and 
in such a case that when the CM broadcast is 
ended, the reproduction of the highlight scene 
has not yet accomplished, said program repro- 
duces such broadcast data appeared just after 



* 5 47. a computer readable recording medium as claimed 
in any one of claims 39 to 46 wherein: 

said program reproduces a program digest 
constructed of a plurality of highlight scenes as said 
highlight scene. 

48. A computer readable recording medium as claimed 
in any one of claims 39 to 41 , claims 45 and 46 
wherein: 

said storage device stores thereinto a data por- 
tion of the broadcast data corresponding to a 
predetermined time duration at any time; and 
when the CM broadcast is commenced, said 
program reproduces as said highlight scene, a 
30 broadcast data portion which is stored in said 

storage device, and is defined from a time in- 
stant when the CM broadcast is started and un- 
til a preselected time duration is retraced. 

35 49. A computer readable recording medium as claimed 
in any one of claims 39 to 41 , claims 45 and 46 



55 



wherein: 

said storage device stores thereinto a plurality 
of highlight scenes to which importance de- 
grees are allocated respectively; and 
said program reproduces a highlight scene at 
a speed corresponding to an importance de- 
gree thereof. 

A computer readable recording medium as claimed 
in any one of claims 39 to 44 wherein: 

said program reproduces a still image as the 
highlight scene. 

A computer readable recording medium as claimed 
in any one of claims 39 to 44 wherein: 

said broadcast program contains first speech 
(voice) and second speech (voice); and 
said program provides any one of said first 
speech and said second speech when the 
broadcast program is provided in connection 
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with a broadcast time instant; and also provides 
the other speech between said first speech and 
said second speech when the highlight scene 
is reproduced. 

52. A computer readable recording medium as claimed 
in any one of claims 39 to 44 wherein: 

said program contains such a highlight scene 
having a length which is made coincident with 
broadcast time of a CM program inserted into the 
broadcast program. 

53. A computer readable recording medium as claimed 
in any one of claims 39 to 44 wherein: 

said program is further comprised of: 

a step for classifying the highlight scenes 
stored in said storage device into plural sorts of 
classifications; and 

said program reads out such a highlight scene 
having a sort corresponding to a taste of an au- 
dience with having a top priority from said stor- 
age device to reproduce the read highlight in 
such a case that the CM broadcast is com- 
menced. 

54. A computer readable recording medium as claimed 
in claim 42 wherein: 

a step for displaying at the same time, both 
an image of broadcast data in response to a broad- 
cast time instant and an image of a reproduced 
highlight scene on a single display screen. 

55. A computer readable recording method as claimed 
in claim 54 wherein: 

said program changes any one of sizes and 
display positions with respect to said display screen 
as to both a display area for said image of the broad- 
cast data and a display area for said image of the 
highlight scene in the case that the CM broadcast 
is ended. 

56. A computer readable recording medium as claimed 
in any one of claims 39, 41 , 43, and 44 wherein: 

said storage device stores thereinto any one of 
a single set and plural sets of highlight scenes; 
and 

said program is further comprised of: 

a step for providing an index used to se- 
lect a desirable highlight scene when the CM 
broadcast is commenced. 

57. A computer readable recording medium as claimed 
in any one of claims 39 to 44 wherein: 

said program reproduces any one of the high- 
light scene and a digest constituted by plural high- 
light scenes of a certain broadcast program during 



a time period defined after said certain broadcast 
program is ended and until a next broadcast pro- 
gram is commenced. 
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